People travelled from all over to see the building that was once home to Yates's Wine Lodge