Those responsible for repeated acts of anti-social behaviour on buses could have their free bus passes stripped from them, after a minister backed proposals to do so.