The building was designed by Edmund Woolley and Andrew Hamilton, who also
designed several other nearby buildings including City Tavern (which is now a restaurant), St. Peter's Church (now home to Christ Church), and Carpenters' Hall. Construction on this sandstone structure began in 1730 by order of King George II who wanted to have "a stately palace" built here for himself. However, he died before work could begin on what would be known as "the palace."