More than 6,000 banks and building societies have closed in the last decade.