A first-time BJP MLA, Gupta was sworn in on Thursday as the Delhi chief minister in a grand show of strength by the party