A large traffic island near the seafront is being dug up as part of a controversial development designed to “transform city centre public space”