In 1848, Lord Bute inherited the castle,  adding his eccentric touch to the existing Georgian mansion. He hired the famous architect William Burges to remodel the castle, allowing him unlimited funds. Burges, an opium addict, worked on the project until his death. The Winter Smoking Room is located in the tower. There, among the eclectic decor, images of Saxon gods adorn stained glass windows.

These images are based on the seven Saxon gods who gave their names to the days of the week, which first appeared in Richard Verstegan's Restitution of Decayed Intelligence in Antiquities published in 1605.