If you change the proxmox ssh port modify the /root/.ssh/config file to include the new port:

Host 10.0.1.2 10.0.1.3 10.0.1.4
   Port 2222