Some thoughts:
First, while firearms will always be more efficient at taking out the zombies, I'd definitely want some melee type weapon for when the ammo runs out or when a reload just isn't possible. I'm thinking machete. It's light and you don't necessarily need a killing blow. Go for a leg and cripple that ex-human to get some breathing room.
Now, lot of you may consider the mountains or some other country locale, but don't forget, you may have to deal with zombified wild animals. Can you imagine having to deal with a zombie bear?
Now, I personally don't have any large bodies of water near me, so I'm thinking farmhouse. They will usually have spare fuel and food. There will likely be some interesting farm implements with which to take down stray zombies. Lots of open area is key, I think, plus if you choose well, there won't be much of a local population to be turned into zombies.
(*important note- stay away from livestock farms as zombie cows may be difficult to deal with.)
Edit: TPI makes an interesting point, approach farmhouses carefully. Recon is a must.