It could be the power supply, but also motherboard, or one of its attached components.
Normally when something else than the power supply is broken, it will beep one or more times, or have led lights, indicating what part to be looked over.
I remember one time when I got this problem, I did a Bios reset, and after that it worked. It's worth a shot.