When I have issue with my connection dropping out and they are frequent, like 3-4 times a week, I look at rebooting the router. If it clears up and works great..... nice pings to a number of sites and fast loads and so on.... I start looking for a new router.
Good luck with the other suggestions, and I hope one of them solves it, but my guess would be its time for a new router.