Rajasthan Chief Minister Bhajan Lal Sharma will attend the swearing-in ceremony for the Chief Minister of Delhi on Thursday.