The point in slotting the flaps is not to add lift directly. I think it actually lowers the lift compared with the non-slotted flap given same conditions. What it does is to allow reaching higher angle of attacks before stalling the wing. Thus, the maximum lift coefficient is increased. The added drag associated with ALL flaps is usually a welcomed feature to facilitate its main function - to assist with landings.
In order to benefit from the potential extra lift to maneuver, the plane has to be able to handle the extra drag - either by making the flap more efficient (adding less drag, but still adding) or by exploiting the extra power of the engine to offset the drag penalty (basically converting thrust to lift). Thus the potential gain from flaps in slow maneuvering is largest for high wing-loaded planes with good power/weight ratio, almost regardless of the type of flaps. Larger area flaps will gain you nothing in terms of maneuvering if you don't have the power to spare, or that you can't control the torque at that speed (hence, can't use the available power). This is why comparing kinds of flaps on different planes is not very accurate to say the least.
The physical speed limitation on the use of flaps comes from the concern of bending the flap mechanism. The more lift generated, the greater the stress on the flap. Lift is proportional to G (for a given weight). However, even at 0G, there is still some stress on the flap due to the drag it adds. Numbers you see in pilot manuals (max velocity in this or that settings) refers to level flight - 1G, NOT FOR MANEUVERING. Since lift is also proportional to the velocity squared, I'd estimate that the safe-use speed for higher G load is lower by a factor ~sqrt(G). That is, if the stated safe speed to use certain flap setting is 200 mph, it will be only about 140 mph when making 2G maneuver and 115 for 3G. Thus, flaps are safe to use only in really slow maneuvering where you can't pull much higher G anyway. Definitely not extending at 400mph and pulling 6G like some planes can do in AH. This is a very rough estimate, but I think it explains why maneuver flaps were not "must have". Simply, in order to extend the envelope of save usage, the flaps had to be so sturdy and heavier that it was not worth the effort. They were useful in a very limited way. That is my opinion anyway.