Original explanatory diagram
SimpleQA narrowed factuality evaluation to short answers with inspectable grading
OpenAI introduced the SimpleQA factuality benchmark on October 30, 2024, using short fact-seeking questions and source-supported reference answers for tractable grading.
Read analysis