The town is facing a growing divide over Glastonbury’s World Heritage bid