Councillor who defected from Labour says the party has "lost its way" as he joins Greens