A plan to turn a former children’s home into 30 flats is facing dozens of objections from people living nearby.