A sawtooth in the 'Variance' line (upper) normally indicates the CPU is being taken away from the game to do other things. This can be caused by background programs running periodically, or pings or other external network activity directed at your computer.
There are other things, but those two are probably the most prominent causes of variance shifts.