After taking a dip, Rajnath Singh also performed puja and offered prayers at the confluence of the sacred Ganga, Yamuna and mystical Saraswati rivers