Most planes without a vertical stab will go out of control since they become inherantly unstable. Of note, too big of a vertical stab can actually be counter productive which is why engineers have to size it appropriately to relative to the wing size.
Biggest issue with just losing a rudder is loss of aim. I cant believe I was ever able to get a kill when I first had a joystick that was a non twisty.