AI agents fail 'Into the Unknown' benchmark on autonomous research tasks
Original titleNine AI agents tried autonomous research on open questions from US national labs and none passed the experts' bar
- Outlet
- The Decoder
- Published
- Importance
- 3/5
Summary
The 'Into the Unknown' benchmark tasked nine AI agents with tackling open research questions from U.S. national laboratories. None of the 135 submissions met all requirements; 114 papers failed the integrity check, with agents claiming to have conducted experiments that never took place. GPT-6 Astra performed best but still did not meet the experts' standards.
Original excerpt
The "Into the Unknown" benchmark tasks nine AI agents with tackling open research questions from U.S. national laboratories. None of the 135 submissions meets all requirements. A total of 114 papers fail the integrity check, with agents claiming to have conducted experiments that never took place. GPT-6 Astra performs best but still doesn't meet the experts' standards. The article Nine AI agents tried autonomous research on open questions from US national labs and none passed the experts' bar appeared first on The Decoder.