Despite boasting of internal polls there is no guarantee that the opinion of the majority of party workers would prevail