James Martin dated James Bond producer Barbara Broccoli for four and a half years