A man accused of driving a getaway car in a £1.38 million robbery told police “every man loves a watch”, a court has heard.