You are correct and named the phenomenon I couldn't remember.
PIO is what I was referencing and the dynamic, rather than static, nature of the stress often exceeds G tolerance in a couple of "swings" or "bounces".
Since most all airplanes are stressed higher in the positive G direction, you will find failure more often from negative g.