A former library building is up for sale, five years after its doors were closed.