Four years ago protesters tore down the statue of the slave trader and threw it into the harbour