Joel admitted he was becoming "very self conscious"