I do not understand what USB has to do with the mouse in VBox. The mouse activity is simply passed through from the host mouse driver to the virtual mouse driver, in the guest. USB, in the guest, has nothing, at all, to do with that. If VBox has a problem getting mouse activity from the host driver, there could be a problem, but that would be VBox, or the virtual mouse driver, not the USB driver, in the guest. If it stops happening, when you reduce the virtual screen resolution, that does indicate some sort of VBox problem.
What, exactly, is the configuration?