An 87-year-old referee has announced his retirement after dedicating more than 50 years to the sport.