A wander through this tiny town on your next trip to the South West is a must, writes Sue Yeap