A pensioner living next to the A417 Missing Link project will have to access his home through a private tunnel that could cost up to £6 million.