1stpar3 - I had the same experience with my first VR headset - a Lenovo Explorer. I wore glasses while using it, but thought I was always very careful about maintaining distance between the lenses and my glasses. Yet, before long, I noticed a smudge in one of my eye's views - and it turned out to be a scratch, caused by my eye glasses.
I was able to buff out the scratch using this product:
https://www.amazon.com/Polywatch-Plastic-Lens-Scratch-Remover/dp/B0014R9V9O Worked like a charm and restored the lense perfectly.
After that, I cut an additional foam pad for the circumference of my headset out of some old unused adhesive-backed foam weather stripping I had saved. This increased the distance between my eye glasses and the headset's lenses and prevented further scratching.
I am not positive, but I think a product like Meguiar's PlastX might work just as well.
When I got a new headset, I ordered special corrective lense inserts from VROptician for my specific headset, ground to my distance vision prescription, so I no longer need to wear glasses in the headset.