Some people won't turn for the fight until you show them some tailfeathers. Don't let it bother you all that much. I find these types aren't very confident and can usually be forced to overshoot and be punished. Just keep an eye on them for their turn back to you once they think you aren't looking.