One resident of the tourism hotspot says he is forced to call the police on unruly visitors every weekend and that Airbnb flats have "destroyed his life".