Thing is, the swastika has been around a lot longer then the Nazis. The sounds that make up the word swastika are from sanskrit, and it has a nice history right up until some german fellas decided it fit their ideas of destiny and thousand year reichs.
Check out this history/article about the symbol:
http://en.wikipedia.org/wiki/SwastikaI listened to a story on NPR about a gentleman who is frustrated that the hindu use of the swastika has essentially been erased in some parts of the world because of the Nazis and is trying to educate people to seperate the symbol from the people who used it.
Should it be banned? No. It's just a freaking symbol. Symbols, like flags, don't mean anything unless there are movements of people supporting them. To head off the inevitable argument at the pass, if a hindu uses a swastika as part of their religious observances, are they giving comfort and solace to neo-nazis?
The KKK burned crosses and supported the erection of lit crosses above many towns as a means of intimidation by 'shining the light of christ' on blacks, does that mean the cross should be banned? Of course not.
Seperate the symbol from the people. This applies to the swastika as much as it applies to the cross.