Check your outside view, if the rudders have turned when you're in the gunner position. If they have, check the key/controller mapping (for Mode2 if you have AutoSelect Mode checked) for some button to have rudder input.
I don't even suppose you're just kicking your rudder hard when moving to the gunner position even though I've done that myself.