Lord and Lady Montagu will not live at Palace House