The gardens feature an extraordinary architectural layout and stunning views of the Yorkshire Dales. Sir William Milner was largely responsible for their design and planting in 1927 and they benefit from a wide variety of soils, including limestone and gritstone, which allows rhododendrons and camellias to grow alongside limestone outcrops. It is also a plantsman's garden with naturalised daffodils, including 'W F Milner' and beside the lily pond are to be found naturalised Primula florindae given by Kingdon Ward. There are fourteen Stations of the Cross in the grounds.