Bringing Grails plug-in inplace auto-generates Run/Debug configuration entry

Whenever I have a Grails plug-in inplace IntelliJ generates a "run-app" entry for it in Run/Debug. Manually deleting these entries is fruitless as they just get recreated the next time IntelliJ starts. Is there a way to globally control this behavior while still allowing for the other Grails project structure tasks to run normally?

Thanks.