The owners say many people were sad to see the former cafe close down