A popular cafe in East Lothian has announced “with great sadness” that it will close for the final time next week.