Cllr Liz Grey said her comments had been misrepresented after the Conservatives said they were "derogatory and dismissive”