Congress president Mallikarjun Kharge wrote the letter after speaking to Modi about setting up a memorial for Singh, who was a two-term prime minister revered by the people of the country.