The Conservatives have a “fundamental problem” when it comes to recruiting young women to the party, the shadow minister for women and equalities has said.