There's a place called Kaikoura in New Zealand on the South Island. It's a small town - population 2000 or so - that sits right on the ocean and is surrounded by a ring of snow capped mountains. On a clear day it is one of the most stunning places you could ever hope to see. Turn one way and you've got the mountains... turn the other and you've got the sea!
About a mile off shore, the ocean plunges down around 1800 feet into a huge underwater cravasse. The depth here means that lots of sperm whales and humpback whales pass through and it's relatively easy to jump on a tour boat and go out and see them - one of my happiest days travelling in New Zealand.
I'd choose ocean over mountains any time I think, but I love diving and dislike oxygen deprivation at height, so I guess I'm biased
