Cannot remove project .idea folder

I accidentally opened my Desktop folder as a project in IntelliJ. And afterward, I cannot open my projects in the subfolder of the Desktop anymore. Even after deleting the folder at ~/Desktop/.idea , when I open any projects in the subfolder, it will open as project Desktop, and Desktop/.idea will be created again.

BTW I'm using OS X.