Tommy Fury had been in talks with I'm A Celebrity... Get Me Out of Here! bosses for months about appearing on the show