The alleged remark is said to have been made amid talks at the council's Town House - but accused party Derek Davidson insists he "does not swear".