A group of Liberal Party members, supporters and former officials have urged the party to dump its nuclear vow, with fears it will lead to an election defeat.