Gladiators host, appearing on a podcast, explained he was 'convinced' the evidence showed an incredible truth about the construction