It would make no difference to me ... either way.
Currently, I never look at the other planes control surfaces ... unless they fall off.
I simply concentrate on the overall silouette of the plane to judge its intended directions/moves. I guess this comes from playing sports that require you to watch the "overall" body and not get caught concentrating on someones hands, feet, head, etc which are generally used to "fake" you out.