'This is not television. This is real life. People live in those houses,' judge points out