The Ministry will look into the matter and the factors that led to the use of abusive language