Plans to build a modern farmhouse in the grounds of Stonyhurst College in Hurst Green have been refused.