Jones shared his view on the former president after ‘hanging out with him’