Congress Chief Mallikarjun Kharge accused Prime Minister Narendra Modi of fearing the caste census