After police received "so many complaints" from locals and retail staff, a Criminal Behaviour Order has been secured for convicted burglar.