I've always wondered the same thing. It's such a simple, quick, easy check "controls free and correct"…why not do it?
I did a lot of flying off of gravel and grass runways as well as off field operations and just before adding power did a quick control check in case a rock or other debris had blown into a control service jamming it. (While a rare thing it can happen, I had a glove from a skydiver exiting at 11,000 jam my elevator at about 2/3 up….it can happen).
Back in the 80s there were two fatal Beaver crashes here where airplanes just out of maintenance had the ailerons hooked up backward (evidently an easy thing to do on a Beaver)…a simple "controls free and correct" would have caught the maintenance error.
All that being said I've screwed the pooch before and missed something I shouldn't have…..I was lucky enough it was something small enough it didn't kill me or bend an airplane.