How to setup remote ssh console inside a Docker container ?

I'm trying to setup a remote interpreter which lives inside a Docker container through SSH. The reason I have to do this is that the container must be run using nvidia-docker, which PyCharm doesn't support AFAIK.

I am able to connect via SSH and I can even use PyCharm's debugger, however the console and the normal Run configuration (which works through console as well) doesn't work. I believe this is because the pycharm helper tries to create a server on the Docker container which PyCharm cannot access because the port isn't mapped to allow inbound connections to the Docker container.

I've looked around quite a bit to solve this but haven't found anything so far. Does anyone know a solution to this ? I'm open to changing my setup as well ofc.