A minister has said the government can not currently afford to fund a new rail link between Oxford and Witney campaigned for for 10 years.