Hundreds of residents are opposed to homes being built on land outside the village