The former Gardeners' World star has been married to his wife Alison for almost 50 years and has opened up about the couple's relationship in a candid new interview