Make non-modal commit windows close itself after I made my commit

Hello everyone,

I'm using IDEA 2020.3 Ultimate and what really annoys me is that after I made my commit (without using Push afterwards), the commit dialog (I'm using the new non-modal one) stays open.

Does this have to do something with that I have pending local changes in another changelist? I want the dialog to close automatically even if there are other local changes.