The earliest known mention of the castledates from 1188 as "castrum Breidervort". On the forecourt of the castle developed a small city during the time. In 1646 the Powder Tower of the castle was struck by lightning. The explosion did hit the castle and city which was badly damaged. The castle was a ruin. Lord Haersolte and his family were all killed by the explosion. Only one son, Anthonie, survived the disaster. He was not at home during the disaster. In April 2009 there were found heavywallremnants on the site during excavations. Some parts of the Curtain wall of the castle are made visible by brassmarking on the square.