"If he does not resign, it's incumbent upon the prime minister to kick someone like that out"