Thousands of people are backing the proposals despite council concerns over 'harm' to the town's heritage