The Prince and Princess of Wales have enjoyed trips to the Caribbean island since their dating years