How to rebuild Docker remote interpreter

So I found the whole Docker integration a bit convoluted, compared to the simplicity of running it outside. But the specific problem I have is this:

I have setup a Python Remote Interpreter with Docker Compose. I can run and debug the project through this. But if I change a package requirement, I get a warning that I need to install it. I first pressed it as I was used to, and it seemed to do an install, but then when I reloaded the packages on the Remote interpreter nothing had changed and the warning remained.

So what is the correct workflow to update the package requirements with docker interpreter?