What kind of stick are you using , the reason I ask is if the rudders are on the stick then you probably need to recalibrate your stick as the rudder input sounds like it is off. The only time I get nose pointed out to the side is when I am slipping the plane with the rudder for landing and maybe that is what is happening to you, at least that is the only thing that I can think of.
just for what it is worth