The council is to press ahead with knocking down five tower blocks after demolition experts were appointed.