I can confirm this bug...
If you switch sides in one arena, then go to another arena and switch sides, and then try to switch back to your original side it doubles the time out...however if you try to switch not back to your original side...and rather the third side...the time out is correct...
If you log out of the game and restart...then both timeouts for both arenas are correct...
Frankly I don't switch sides so I don't really care...but the OP posted this on another board and I was curious and ran some tests...
Oneway