Southampton libraries are reopening as warm spaces to help the community this winter.