Village leaders say the surge in tourists visiting their community has become ‘intolerable and unacceptable’