George Digby, Earl of Bristol, was born in 1612, and was educated at Oxford; he soon became distinguished by his remarkable advancement in all kinds of elegant literature. In the beginning of the Long Parliament he was disaffected to the Court; shortly afterwards he appeared a declared enemy to the Parliament; and having testified his dislike of their proceedings against Lord Strafford, he was expelled the House of Commons in 1641. Upon the death of the king his lordship was exempted from pardon by the Parliament, and obliged to live in exile till the restoration of Charles II., when he recovered all he had lost; he grew very active in public affairs, spoke frequently in Parliament, and made himself conspicuous for his enmity to Lord Clarendon. Lord Bristol died in 1677, “neither loved nor regretted by any party.” The house at Chelsea he bequeathed to his Countess, Lady Ann Russell, daughter of Francis, Earl of Bedford, who sold it in 1682, to the Marquis of Worcester, created Duke of Beaufort, and who died in 1699.
The name of the house was now changed to Beaufort House. Mr. Evelyn, in his Diary, makes frequent mention of it:—“I went with my Lady Sunderland to Chelsey (1679), and dined with the Countess of Bristol (her mother) in the great house, formerly the Duke of Buckingham’s, a spacious and excellent place for the extent of ground and situation, in a good air. The house is large, but ill-contrived, though my Lord of Bristol expended much money upon it. There were divers pictures of Titian and Vandyke, and some of Bassans, very excellent, especially an Adonis and Venus, a Duke of Venice, a Butcher in his shambles selling meat to a Swiss, and of Van Dyck, my Lord of Bristol’s picture, with the Earl of Bedford’s at length. There was in the garden a rare collection of orange trees, of which she was pleased to bestow some upon me.” Again, in 1683, Mr. Evelyn says, “I went to see what had been done by the Duke of Beaufort on his house at Chelsey; he had made great alterations, but might have made a better house with the materials and the cost he had been at.”
Henry, second Duke of Beaufort, by his will, dated in 1712, left all his estates, in trust, to be sold, and the produce appropriated according to a settlement made at his marriage. The house, however, continued to be the residence of that noble family till about the year 1720. Mary, relict of the first duke, died here in 1714, at the good old age of 85 years.