I used a GPS while flying. I thought it was absolutely great as a SECONDARY means of navigation. I always had my sectional out and was aware of my location from orienting from the map and terrain then used the GPS as a confirmation.
If you are over the top or in solid clouds you really don't have much choice which to use in some areas as you'll be out of VOR range. NDB's can help but won't be really precise.
For blue water the same can be said as there are few road signs in the ocean and loran is or has gone away. If you have a sextant, tables, charts and skill you can navigate the old fashioned way on the water.