A 140-year-old racecourse could be put in public hands for a $5 billion price tag as part of a plan to turn the pivotal site into a "mini city".