Fans are "fuming" to see the actress bid farewell