Reverse game theory aims to keep AI agents aligned with human values
Original titleHow “reverse game theory” could keep AI agents in check
- Outlet
- MIT Tech Review
- Published
- Importance
- 3/5
Summary
A new approach called reverse game theory aims to control powerful AI models by designing systems that incentivize them to follow rules. As AI models become more capable, safety researchers are working to ensure agents remain aligned with human desires.
Original excerpt
A new approach known as “reverse game theory” aims to control powerful AI models by designing systems that incentivize them to stick to the rules. As AI models become more capable, safety researchers are scrambling to ensure they are “aligned” with human desires—to make sure, in other words, that rogue agents don’t break the law,…
#agent#safety#alignment#game theory