The charity Ambitious About Autism has dropped him as an ambassador after the complaints