Highclere Castle Grounds with Tree. Highclere Castle, in Hampshire, is the home of the Earl and Countess of Carnarvon and is used in the filming of the British TV series Downton Abbey.