For me, RubyMine's test/debug environment has broken over and over again as various pieces of my dev stack are upgraded.
After wasting tons of time, I've started running tests in a standalone console using a test-runner based on Guard.
Also I wrote a custom rspec formatter that automatically opens the failing spec in RubyMine. ( see https://gist.github.com/3202065 )
This has been working well - simple, fast and very reliable.
I wonder if anyone else has written add-ons like this? I'm interested to learn about hacks/tricks/experience from others...