I have some severs under the "Build, Execution, Deployment" > "Deployment"
But when I do a right-click, "Upload To..."
I only see one of them.
And its not the one that I set as Default, which is the one I'm trying to upload to.
So I can't upload via PS.
Under the "Remote Host" tab, its able to connect to and display the remote server fine.
The development path on server was left empty and thus invalid.
Have entered the correct path and its working now.