One of Britain's oldest referees is hanging up his boots at 84.