Multiple default servers

Lets say I have 4 folders included in a project.

2 of the folders deploy via FTP to ServerA
1 of the folders deploys via SFTP to ServerB
1 of the folders deploys via a local network share to ServerC

Is it possible to get Compare With Deployed Version working on all servers in this situation?
It works for each folder individually (after I go into deployment settings and set that Server as default) but then the other folders stop working.
The files within the other folders only have an "Upload to.." option, which when selected only has a single server in the list.

Maybe if there is only a single server it can treat that as a pseudo-default server?

Or if anyone knows a way to do this please feel free to share.

Cheers,
Dave