Conservative peers are seeking a judicial review which if successful would overturn the decision to cede the British Indian Ocean Territory.