There are talks the flats could be used to house asylum seekers