Prince Harry and Meghan Markle have spent Christmas in California for the past few years, with only Doria Ragland joining them at their Montecito mansion for the festive season