The Loose Women star left her fans 'gutted' as she quit one of her huge jobs for the sake of her family life