Things took an unexpected turn as Simon Rimmer accidentally swore live on Channel 4's Sunday Brunch alongside Tim Lovejoy and fans were quick to pick up on it