It was claimed the property was already being used as a children's home and there was lots of trouble