One of the children told a social worker: 'I don't know why my parents have to be in court again'