The well-known blue and grey building had a 64.5 per cent vacancy rate in May 2023, according to an independent report