Congress President and Leader of Opposition in the Rajya Sabha Mallikarjun Kharge on Tuesday raised concern over the delay in conducting the decadal census and urged the government to immediately start both the decadal census as well as the caste census.