Actor made his feelings known amid couple's divorce