Senators says the government's appetite for borrowing has seen public debt balloon.