Andrew Bailey said the rise in the costs of servicing government debt - which also affects mortgage rates - had been partly a response to the Budget.