If your after cool weather the Southern Highlands -- Mittagong, Bowral, Berrima, Moss Vale, you could spend a couple of days (2 days inc trav) then onto Goulburn and down the coast to Batemans Bay for a day (2 days inc trav) then a slow trip back up the coast road to Sydney for 3 days, Sholehaven, Nowra, Shell-Harbour, Kiama and the coast road from Wollongong through the coastal villages.
Bass Point at Shell Harbour is both good diving/fishing, Batemans Bay (Boating) and a good RSL club.
Bowral has some great coffee shops, Berrima a tourist place (shopping, trinkets etc), Mittagong and Moss Vale both have fair RSL clubs and not much else.
Suitable for the 40 plus age group.