It is understood he is going to his Highgrove estate in Gloucestershire.