‘Where was this industry when you needed them?’ former ‘X Factor’ judge asked