Allardice castle was the chief seat of the Barons of Allardice, an ancient family who first appear in an 1197 charter. The lands belonging to the Allardice estate lie within the parish of Arbuthnott, and lie to the south of the land belonging to the Viscount of Arbuthnott's estate. Since 1542 many alterations and changes have been made to the original structure. As such, the original plan is unrecognisable.