The prime minister said Lord Alli had provided him somewhere that his son could study ‘peacefully’