A planning inspector said the proposals would 'impact on the openness of the green belt'