The gardens behind the Governor’s House is beautiful and has a stunning view of the harbour.