A popular bakery in East Lothian has thanked its customers after taking the “difficult decision” to close permanently.