Ben Miller, who played Lord Featherington in the hit Netflix show Bridgerton, admitted he was surprised by the amount of 'hanky panky' in the series