No.  It's all about attitude.  I can very easily see that people who refuse to drink don't get as far as people who do drink.  Being in college, it's very evident whether or not a person drinks just by the way he or she acts.
And maybe it's because we're all drunks, but I don't enjoy being around non-drinkers.  And that doesn't mean I don't like them at parties, I just don't like their attitude for everything.
"I can't trust a man who doesn't drink." - John Wayne
"Why should I trust someone who doesn't trust themselves to drink?" -Me