It is just Vista, more than likely. If you went from XP to Vista on the same hardware, you can definitely expect worse performance under Vista. There is no way around it. It is the nature of the beast.
Anyone claiming to get better performance going from XP to Vista simply hada bad installation of XP. Logic dictates Vista will be slower than XP on the same hardware.