Revelation comes after comedian said he was ‘banned’ from seeing royal