Found the issue: drivers. After checking both the headset and 3080 on the device manager, went to the Nvidia app, pecked around and found an option for clean reinstall of the drivers. Did that and the frames rates in VR are now running normally. Apparently, one of the last updates dropped something nasty in the punch bowl, cause the low frame rates.