An Inverclyde bus firm has warned it won't hesitate to withdraw services in the area to protect staff and passengers in the light of rising levels of abuse towards drivers.