The Government has ruled out a public holiday to mark the 8 May anniversary