A politician has spoken out amid mounting concern over the state of one of West Yorkshire's town centres.