Controversial plans to ban new holiday homes being built in one of Britain's most beautiful areas have split the community.