Grayson Perry has spoken out about his time on the hit ITV singing competition