The shadow home secretary said hard work was missing in Britain