The former state governor resigned four years ago following allegations of sexual harassment