Insight tag

Scale AI

2 related stories.

Stories

Original explanatory diagram

News analysisRelease: September 19, 2025Published: October 23, 20263 min read

SWE-Bench Pro brought private and long-horizon code tasks into agent evaluation

Scale AI introduced SWE-Bench Pro on September 19, 2025, a 1,865-problem coding-agent benchmark spanning public, held-out, and commercial repositories.

Read analysis

Original explanatory diagram

News analysisRelease: January 23, 2025Published: October 23, 20263 min read

Scale AI Center for AI Safety Humanity’s Last Exam Evaluation

Humanity’s Last Exam released 3,000 expert-crafted questions for a hard academic test

Scale AI and the Center for AI Safety released Humanity’s Last Exam on January 23, 2025: 3,000 multimodal, closed-ended academic questions.

Read analysis