Residents say they knew nothing about the plan until the accommodation opened