There are several kind of "holding E":
Speed bleed at higher than max level speed
This refers to diving into a speed the plane cannot sustain and waiting for the speed (kinetic energy) to sip away. Specific drag (drag/mass ratio) is very important here. Also engine power and some properties of the prop help because at high speeds the prop produces drag.
Speed bleed while maneuvering
This refers to energy bleed while pulling G. In addition to form-drag, induced drag play a large role. Induced drag roughly behaves like the lift squared (D~L^2) and if we are maintaining a constant G, that means also D~G^2. The exact proportionality depends on the wing-loading (because less weight means less lift is required to maintain G) and the properties of the wing. A spitfire has large wings for its mass that provide quite low mass loading and they are elliptical, a shape that reduce the induced drag. This is why Spits keep their speed up "well" even in a high G turn. I have seen Yak3s with a dead engine keep fighting, scissoring, circling a base and landing with what seemed like minimal energy loss while maneuvering. Not sure why, but I did not check its wing loading numbers. Most other planes would have fallen out of the sky if they tried that.
Now, planes do not have to hold their E - they can spend it and immediately replenish it by engine power. Therefore, high power loading can replace aerodynamic efficiency in "keeping E" and the engine helps in sustaining hard turns. La7s and 109K4s immediately come to mind as examples. There are planes that combine several qualities - Spit16s and Yak3s have a good power loading and seem to suffer very little from drag at high G.