If remote desktop freezes for a few seconds and then comes back, or drops every so often, it is almost always one of these three things. Go in order.
1. UDP transport (the most common cause)
Windows remote desktop uses UDP to feel smoother, but if packets get lost on the way (wifi, home routers, some ISPs) the picture freezes. Forcing it to use TCP only fixes it in most cases. It is done on your PC, not on the server, from a terminal opened as administrator:
reg add "HKLM\SOFTWARE\Policies\Microsoft\Windows NT\Terminal Services\Client" /v fClientDisableUDP /t REG_DWORD /d 1 /fClose remote desktop and reconnect. To undo it: the same command with /d 0.
2. The server is maxed out
If the VPS runs out of RAM or sits at 100% CPU, Windows starts killing processes and the remote desktop session is among the first to go. Check the graphs on the panel's Overview tab or Task Manager (Ctrl + Shift + Esc). If that is it, restart from the panel to regain control and find what is consuming it: how to check usage.
3. Your connection
- Try a cable instead of wifi.
- Lower the quality: in Remote Desktop Connection → Show Options → Experience, choose a slower connection, and under Display, a lower resolution.
- If other internet services also stutter, the problem is your network.
Still the same?
Run an MTR to your VPS's IP while it happens and open a ticket with the result: it tells us where on the path packets are lost.