The beloved actor died 'with his friends and family at the end,' his family said