Small changes to our diet could have long-term consequences, the research suggests