The grade-II listed building was built for the Pearl Assurance company in the 1950s.