The building was most recently used as part of offices for town solicitors