Sage-Taiyi, a metacognitive architecture for scientific discovery, tops AI ideation benchmarks
Original titleSage-Taiyi: A Metacognitive Architecture for Scientific Discovery
- Outlet
- Hugging Face
- Published
- Importance
- 3/5
- Trending
- 19
Summary
The authors introduce Sage-Taiyi, a metacognition-inspired architecture that guides what to investigate next and how to investigate it by revising understanding of evidence and assumptions. On the Taiyi-Bench AI co-scientist ideation benchmark of 265 tasks from 50 papers, Sage-Taiyi achieves an overall score of 54.0 compared with 47.9 for the strongest baseline, AI Scientist-v2. Expert-guided collaborations validated proposals in chemistry, raising cobalt-catalyzed carbonylation yield from trace amounts to 84% and photocatalytic allylic amination from 13% to 69%.
Original excerpt
We introduce Sage-Taiyi, a metacognition-inspired architecture that uses accumulated scientific understanding to guide what to investigate next and how to investigate it. Through explicit monitoring and control, the system revises its understanding of evidence, assumptions, and unresolved questions, then uses these assessments to adapt research targets and select reusable reasoning methods. On Taiyi-Bench, an AI co-scientist ideation benchmark comprising 265 tasks from 50 papers across ten disciplines, Sage-Taiyi ranks first on all eight metrics of historical rediscovery and open-ended ideation, achieving an Overall score of 54.0 compared with 47.9 for the strongest baseline, AI Scientist-v2. It also performs well on two external scientific ideation benchmarks. Five expert-guided collaborations further connect its proposals to experimental and computational validation across chemistry, materials science, and engineering. In chemistry, reaction-condition optimization raises the yield of cobalt-catalyzed carbonylation from trace amounts to 84% and photocatalytic allylic amination from 13% to 69%. These results support metacognitive regulation as an approach to scientific ideation and its progression toward practical validation.