Fences and walls have been damaged along a route up Wales' highest mountain