Viewers of the BBC show were quick to pick up on the absence of two regulars