The Duke of Sussex has experienced some strained relationships with members of the Royal Family over the last few years.