The Albanese government has copped more friendly fire, this time from a former Labor minister claiming the party has lost touch with its working-class base.