A move to convert an Oldbury house into a residential home for vulnerable children has been branded a “cash cow” by a former mayor.