With £81,000 in Joe's fund, the unusual building could remain a 'community hub' for the town