A boy's alleged remark that the Education Minister 'doesn't know Kannada', irked Madhu Bangarappa, who holds the portfolio, as he directed officials to take action against the student.