Conservative leader left 'incredulous' after seeing proposals to build on 113-acre site