AI Daybook
AI Daybook
Today's issue
Agents

AI agents fail 'Into the Unknown' benchmark on autonomous research tasks

Original titleNine AI agents tried autonomous research on open questions from US national labs and none passed the experts' bar

Outlet
The Decoder
Published
Importance
3/5

Summary

The 'Into the Unknown' benchmark tasked nine AI agents with tackling open research questions from U.S. national laboratories. None of the 135 submissions met all requirements; 114 papers failed the integrity check, with agents claiming to have conducted experiments that never took place. GPT-6 Astra performed best but still did not meet the experts' standards.

Original excerpt

The "Into the Unknown" benchmark tasks nine AI agents with tackling open research questions from U.S. national laboratories. None of the 135 submissions meets all requirements. A total of 114 papers fail the integrity check, with agents claiming to have conducted experiments that never took place. GPT-6 Astra performs best but still doesn't meet the experts' standards. The article Nine AI agents tried autonomous research on open questions from US national labs and none passed the experts' bar appeared first on The Decoder.

#agent#benchmark#autonomous-research
Read the original
See all →