Situated within wooded grounds on the banks of the River Tay, Murthy Castle lies 2 miles (3 km) northwest of the settlement of Murthy. The castle comprises a four-storey 15th-century square tower, which has been extended to surround three sides of a courtyard. An original castle on this site is thought to have been a hunting lodge of the Kings of Scotland. Once the property of Abercrombies, it passed to the Stewarts of Grandtully in 1615. The tower remains occupied.
A new mansion was built nearby for Sir John Stewart in 1827-32 in the style of a Jacobean palace by architect James Gillespie Graham (1776 - 1855). This was never completed internally and was finally demolished in 1949, the stone subsequently being used to build the dam and hydroelectric station at Pitlochry. Sir William Drummond Stewart who inherited the estate from his brother in 1838 travelled extensively in America, returning to Scotland with two native Indians who lived in the 17th-century Garden House in the policies of Murthly Castle. Sir William was nursed back to health by Jesuits and converted to Catholicism. He built the fine Chapel of St. Anthony the Eremite in 1846, next to an existing Mediaeval mortuary chapel behind the castle. This building was designed by James Gillespie Graham (1776 - 1885), probably in collaboration with A. W. N. Pugin (1812-52). Richly decorated inside, it was restored in the 1990s,
