When flying the P-38, that is perhaps true. However, when flying something like an Me-109, it becomes literally impossible to control the roll at certain speeds without trimming. Moreover, one's hand tends to get a bit tired (although gaming joysticks obviously don't have significant stick forces) holding the stick off to one side. In my case, I just had hand surgury and my other hand needs it so I am taking every precaution to avoid stressing both of them.
Another reason for trimming your airplane at all times in game is joystick life. I use CH, and I love them for precision, but they are terrible about durability. Roughly once a year, either my joystick or pedals begin to malfunction. It seems that constantly holding the stick or pedals in a certain position aggrevates the problem, bringing early failure of the potentiometers. The first sign of failure is usually a button not working when the joystick is held in its usual off-center position. For instance, in the P-38, since I usually fly at about three hundred miles per hour indicated, if I never touch the trim I must hold the joystick forward several inches in order to stay level.
On the other hand, trimming the airplane in the game changes the "feel" of it when turning, causing me to sometimes stall when I never would have at the default trim. I'm currently debating whether to go back to my usual untrimmed state or continue trimming after my hands are fully healed. Both have their benefits.
[edit]Oh, I just reviewed your last two posts and your meaning became clear. I'm sorry, I thought that you were talking about trim in the game, the simulated software trim (either bound to a slider or keys). I agree with you fully that there is no reason to use the physical trimmers for your gaming joystick, whether they affect the potentiometers or, like mine, simply the physical center of the gaming joystick.[/edit]