From Olymypic athletes to football legends, the Freedom of the City has only been awarded to a handful of people