Ben Miller, who played Lord Featherington in the hit Netflix period drama, was left surprised by all of the on-screen 'hanky panky'