Father Brown star John Burton, who plays Sergeant Goodfellow, has spoken out on the many cast changes that have hit the show