Victoria’s new opposition leader says Labor’s insults and failure to contest a key byelection show the party is terrified of a voter backlash.