The Prince of Wales once let Princess Kate down after he cancelled plans to spend New Year's Eve with her.