‘It’s sad that [Cubby Broccoli] is not with us anymore, that’s all I can say,’ said the actor