Turned out Display Fusion app (version Pro 10.x the latest as of 1/15/2024) with mouse cursor wrap (cursor appears on opposite side of monitor if you move it off) with horizontal and vertical cursor wrap ON (via check boxes) was the cause of the immediate movement and camera angles changing every couple steps, was unplayable.

Disabled it loading entirely at startup and rebooted, problem gone.