The pair divorced after just two years of marriage