The actor paired the look with a pearl-embellished mini bag from Jimmy Choo