The Weakest Link legend has given a no-nonsense reply