Port Glasgow's Victoria Boxing Club building has been put up for sale.