"The disability lobby is massive and influential," Tony Blair's former political secretary said