The area has been rated as one of the country's most affluent, and features in two Harry Potter films