I think I see your point, I am still not sure I agree with it though.
The biggest problem I see is that there doesn't seem to be a "too high" price for oil. Speculators are buying it from other speculators, so when it comes time for the refineries to buy it the price has already been inflated. It could be more or less inflated depending on how many times it has been 'flipped', but it is still inflated.
One other thing... if oil demand has been falling for 2 years now, why is the price of oil skyrocketing?