Federal Greens and state and city Labor politicians have all opposed high-density developments while fighting to be the party of affordable housing.