Reasoning Arena uses trace tournaments to train reasoning with diverse rewards

Summary

Reasoning Arena is an adaptive training framework that routes non-diverse reward groups to a judge system that constructs trace tournaments to extract fine-grained preferences. It improves competition mathematics and coding benchmarks by 7.6% and accelerates training by 27% to 41% while saving nearly 50% of generation compute.