I wanted to add some new tests, created a file in my test folder (which is marked as tests and every other file in it works as expected). This is a Rails project.
For some reason this file can't be tested in isolation with "Run...".
The only difference is that the icons seems to be different, see screenshot. The top one doesn't work, the other two does.