A former I'm A Celebrity... Get Me Out of Here! star has revealed why he turned down Strictly Come Dancing in favour of Ant and Dec's reality series