One in four young people have considered leaving the workforce in the past year, with mental health cited as the most common factor.