If you're not interested in the eye candy but still not happy with the performance, then I suspect you're in for a full system refresh. You'll want a nice i5 cpu (i7 cpus are often overkill for games), 8GB ram, new mobo, new vid card, and maybe even a new monitor to let you run a higher resolution. You can save some complexity by using the mobo onboard sound unless you don't like the sound quality, but try the onboard sound first. A new PSU might be necessary if your old one doesn't have the right connectors or you have system instability after building the new system, and I use/recommend seasonic because the quality is high and they are very quiet. Also the modular connectors on many new PSUs makes building the system easier and can enhance cooling airflow in the case.
If you have money to burn there are some new gaming monitors coming out that support refresh rates up to 120hz, which can go a long way to eliminating any stuttering you might see on the screen even when at otherwise fine framerates. But I think those are still pretty expensive.
For general system responsiveness, few upgrades beat the utility of an SSD. I put an SSD into my new laptop 2 years ago and it was night and day how much faster the system felt overall. Yes it doesn't play games any better except for reducing load times, but overall the system is more responsive and nicer to use.