Build configuration w/o executing an app

How do I make a build configuration which just builds a project without executing any executable?
I have a windows shared dll project and now CLion opens "Edit configuration" window every time I build it.