The Duke reportedly barely leaves the Montecito mansion which he shares with Meghan Markle