The impacts will be felt among underrepresented groups, along with a shrinking number of people in DEI-related positions in both the public and private sectors, experts said