A major police operation is under way after a man was allegedly stabbed to death on a major road in an inner-city suburb.