A proposal to build a stadium on a portion of the Memorial Centre property has seen fierce opposition from community groups and existing users