Yes. You can access your Windows VPS via Remote Desktop with administrator permission.
Wehostideas offers low-cost hosting solutions which covers all of the major operating systems (including Windows/ Linux / MacOS). Feel free to get a quote about your custom server today.