It slows the rebuild time, not just for the HQ, but for the factories also.
The City supplies the factories which send supplies to rebuild the fields. If you dropped the City to 0% and kept it there, and dropped the ammo factory to 0%, and kept it there, any fields with destroyed ammo bunkers would never have ordnance.