This is a known VNC feature - if you have configured your VPS keyboard in a format other than English (US) and try to paste to the VPS, the specific key positions will still be used as if they were still from the English US keyboard, meaning different characters will be assumed.

In order to correct this, simply convert your keyboard format to English (US) on your VPS and you're good to go.