The Prime Minister has rejected calls for slavery reparations, but Commonwealth leaders have said they will still issue demands at CHOGM.