The poshest towns have fancy bakeries and huge stately homes