Our Farm Next Door star opened up about her kids 'going their own way'