Do you have the VR auto swap disabled? I generally just see the hourglass when it's enabled.
Is that option in the oculus software?
Not sure if it's similar but I'll randomly have my Odyssey VR headset jump to the WMR environment and then go back to AH. Often at inopportune times but no idea why its happening.