For anyone having stuttering issues despite having 40+ FPS, try going into your Playback Devices and switching the sound quality to 44100 or 48000 16-Bit. That seemed to fix ALL of my stuttering problems.
I can't really tell the difference between that and 24 bit sounds. So give that a try and see if it works for you.