Fans were unhappy at Barry McGuigan's treatment on I'm a Celeb