[macOS] Window / Dialogue redirection

For context, I have all projects maximised and in their own spaces.

I'm not quite sure how to title this but I find that every so often IntelliJ gets into a state where it opens a dialog, however it's either on the main space, or not in the space that is used for the window. This results in a game of making sure I can close the dialog before it redirects me back to the originating window.

One way of reproducing it so click inside a file so that the cursor is on it, then to move one space to another without clicking anything and then pressing a shortcut such as CMD + K for commit, the window opens up where you are but the application redirects you to the space where the cursor is.

Is there anyway of disabling this behaviour?