The building has seen Mill Road change dramatically since it was first built in 1838