Death in Paradise star Ben Miller has opened up about his fears of returning to comedy and has revealed the real reason why he won't be returning to the genre