I've found the issue to be fixed when I press any key on the client machine, then the mouse goes over the client machine.

Here is an AutoHotkey script that presses a key over and over that doesn't have impact on anything you are doing at the moment.