Prince Andrew has been living at the Royal Lodge in Windsor since 2003, but may have to downsize his residence to Frogmore Cottage.