I wouldnt consider a 4-5% advantage in level speed as an every way superiority.
There are some other factors, like instanteous turn rate (spit wins by far), E retention during turns (spit wins by far), sustained turn rate (spit wins by far), acceleraion (the spit wins), turn radius (the spit wins by a small margin), flap handling (the 109 has better flaps but it takes long to open/close them), post stall handling (the 109 is more steady but has a higher stall speed and isnt as "easy" as a spit), roll rate (about equal), snap-stall handling (the 109 clearly wins), torque effects (the 109 is just lovely, the spit feels almost neutral) etc etc
As much as i loved flying the 109F, jumping into any spit was just like cheating. Yup, i have never been that much of an expert to suffer from the spits weaknesses like some uber aces out there (cough, cough) 
Not saying that the 109 isnt lovely, just not super training wheel easy mode like a spit. Still the 190 rules all 
I'm afraid you're mistaken about a few things:
A 4-5% speed advantage is the same as the La-7 enjoys over the P-51D. It is significant enough to allow the faster aircraft the opportunity to escape at will while denying the slower aircraft the same. The 109F can force the Spitfire to fight in a disadvantaged position/E-state.
Instantaneous turn rate is the same for both aircraft over corner speed (approx. 250 mph) where both aircraft are limited by G-loading. Below corner speed there is a narrow speed range of about 50 mph where the Spit has a slight edge in turn rate and radius before the speed drops to where the 109F can deploy flaps. Once the 109 gets its flaps out is is a no contest win for the 109; The Spit doesn't really have flaps.
Sustained turn rate and radius:
109F-4, 25% Fuel
No Flaps: 593 ft / 20.4 dps
With flaps: 449 ft /20.8 dps
Spitfire IX, 25% fuel
No Flaps: 577 ft / 23 dps
Full Flaps: 460 ft / 20.3 dps
Acceleration is a metric that is directly linked to climb rate. At altitudes where the 109F has better climb than the Spit it will also accelerate better.
Turn radius, as previously shown goes to the 109F by a
large margin once flaps are out. The 109F handily out turns the Spit in a stall-fight.
However, you are right that the Spit is easier to fly. Especially for noobs. The 109 needs more work with trim and flaps.