The house dates back to 13th-century canonry, with many canons living there up until Leonard Bilson who was imprisoned in 1571 for practicing sorcery. Since then has been occupied by laypeople, served as a school, and during WW2 used as a book and wool store. It was restored by the former Prime Minister Edward Heath and opened to the public after his death in 2005.