Plans to build a huge skyscraper in the city have divided opinion.