Post by Alexandr Wang on X
Alexandr Wang@alexandr_wang
XScale AI & CAIS are releasing Humanity’s Last Exam (HLE), a dataset of 3,000 questions developed with hundreds of subject matter experts (PhDs, profs, etc.) to capture the human frontier of knowledge and reasoning.
State-of-the-art AIs get <10% and are highly overconfident.
🧵

399 likes27 repliesPosted Jan 23, 2025