Daniel Jeffrey has opened up about his time on Gavin and Stacey and revealed how he was tracked down for the recent special after pursuing a career away from acting