Frankly, everybody has at least some sort of fascination towards orderly, 'disciplined' aura surrounding fascist material.
Uniforms gives a person a status, makes him feel a part of something, advocates qualities such as 'team effort' 'mass mobilization' and etc.
Also, the 'mystic' and 'mysterious', 'sinister' qualities surrounding the history of certain groups, always has some charismatic effect on people who look upon it. It's not uncommon.
For instance, while in reality the crusaders of the 12th~14th century were bloodthirsty thungs and scoundrels, people still have today fascination towards some of its elements such as disciplined bands of knights dressed in white, with bright red crosses on their chests. Some people are very great fans of the Empire and Darth Vader in the "Star Wars" movie series and etc.
As long as the historic mindset of fascism is not in direct relevance with some people's hobbies towards military uniforms, I guess it can be tolerated in some special occasions.
Now if those guys would march around in those uniforms like the Neo-Nazi thugs slumming around in some countries... that would become a problem.