Do one then the other.
In particular, paying your mortgage off should be priority #1. Sit on ****ty furniture and watch an old TV. Drive an old car, but not one that's so old you've always gotta have your hand in your pocket. By all means go on a holiday each year, but maybe it's only Coffs or the gold coast, flying economy and renting an apartment one street back from the beach. Do that and pay your mortgage off with religious fervor.
Once you've done that you can relax a bit. Buy a few toys, international business class holidays, Hotel on the beach, etc, etc.
But you've really gotta put the hard yards in first, then relax a little ... doesn't work the other way around. You also gotta make sure you don't get hit by a bus before you change modes, coz that'd be kinda annoying.