Government leader has pledged to bring down the "bulging benefits bill blighting our society".