A survey found nearly half of people were worried about their finances