John Barrowman revealed in 2021 he would only speak about his controversial antics on the set of Doctor Who spin-off Torchwood once