Lazs, everytime a law based on religion is passed, you are affected, whether you know it or not. Most obscenity laws, for instance. How about laws regarding consensual sex between adults? There are states in the union where oral sex is outlawd under sodomy statutes.
When your tax dollars go to religion, there's another place where the theists are taking choice away from you. When our children can't be taught the scientific theory of evolution (you give lip service to science in your last post, what do you tihnk of the evolution debate in the schools?), that hurts all of us. When our kids cannot be taught that the universe is billions of years old because christians think that's "insensitive" to their religion, you're affected. Next time you go under the knife for surgery, do you want it to be by someone who believes that their actions are unimportant and that "god's will will prevail", or do you want a doctor who will fight any complication so that you come out alive on the other end of the operation?
Basically, I'm saying that if you think that you're unaffected by the legislation that theists pass every week, you're not thinking things through.
To come back to the original post, the idea that someone would be untrusted specifically because they're atheist is just another step in the long road towards establishing a theocracy. First, discredit anyone who might disagree, then you're on the home stretch.