It would do that only if you'd paused tracking. If you haven't done it you should map both a pause and center tracking button. Hitting the center button should put you back to looking around without the clipboard following you.
Sent from my Moto Z (2) using Tapatalk