Builders were forced to build a major housing development around White House Farm