I'd look to the connections in the house and from the house to the pole. Also do you have any wireless phone on the line. Old phone line in the house that do not dead end are also a problem. All can cause noise on the line and cause lost data packets.
There are a lot of AH players that use dial up connections and have few problems. I live on the Jersey Shore in an old sea shore town, phone line problems are part of the life here. over the years I've completly rewired my home. That resolved poor line problems.