One Direction star Liam first met Simon when he was 14 on the X Factor