Most small business owners want governments to prioritize removing barriers, according to a new survey from the Canadian Federation of Independent Business.