One of the drawbacks is the limited FOV, it makes high angle high closure rate deflection shoots alittle tougher for me. I don't think the difference from IR to VR is as significant as Hatswitch to IR.
VR is a blast, as a fighter pilot it is an overall net benefit. I think its kind of a pain when level bombing and GVing. Worth a try though, makes the game quite abit more immersive