I think it is fair, yes.
If you are having a difficult time attacking buff formations I invite you to wing with me. I am by no means the best but I am willing to show you how to increase your chances of killing them AND living to land them sir <S>.
I have to agree, it's all in your approach.
I buff hunt a lot in an F4U-1A, usually over a CV. You get lots of practice shooting down bombers when you do CV CAP. Last tour I shot down 52 bombers, 5 got a kill on me.(10.4-1 K/D), this month hasn't been my best, but still I am at 2.5-1.
If you are dying to buff's frequently then it's your tactics, not the buff gunners skill, or the "AI" effect (with the exception of a few)