What was once a quaint village in Hertfordshire is now known as a neighbourhood for the rich and famous.