People were more likely to say fraud had a negative impact on their stress levels and mental health than their financial situation, Which? said.