During the 1540's, when William Cecil was establishing himself both politically and economically, there was a change in architectural fashion in England. The Italian influence was superseded by the classical style of buildings that were popular in France and Flanders. During the 1560's, designs from the Low Countries, particularly those of Hans Vredeman de Vries were influential in England as were those of the Italian architect Sebastiano Serlio and the Frenchman, Philibert de l'Orme. The construction of Somerset House by the extremely powerful Duke of Somerset, for whom Cecil worked, was hugely influential both to Cecil and to other builders of great houses.

In the late 17th century, the 5th Earl inserted arched windows on the south front to enclose a gallery and possibly to repair damage caused during the Civil War, when Cromwell's forces subjected the house to a brief bombardment.

When Brownlow, the 9th Earl inherited in 1754, he promptly employed Lancelot 'Capability' Brown to mastermind the modernisation of the garden, the surrounding parkland and aspects of the house itself. Brown levelled the roofline elevation of the south front, constructed extensive stables, a fashionable Orangery and a Gothic garden summer house. He also demolished the single storey north-west wing to open up the north courtyard and to give views of the newly planted parkland.