‘Trainwreck’ comedian said she struggled to ‘recover’ from the remark