OpenAI racing to finish flagship model using looped transformers for math and coding
Original titleOpenAI will reportedly ship at least one model this year but its flagship still needs alignment work
- Outlet
- The Decoder
- Published
- Importance
- 5/5
Summary
OpenAI is finishing its next flagship model, which uses a looped transformer technique to boost math and coding performance. The technique makes safety monitoring harder, and OpenAI is focusing on alignment work before release. Employees say one or two new models will likely ship by year's end.
Original excerpt
OpenAI is racing to finish its next flagship model, which uses the same looped transformer technique as Astra to boost math and coding performance. The tradeoff is that looping makes safety monitoring harder. Microsoft accidentally revealed details about how the technique works on a public page. Whether or not the flagship is ready in time, employees say one or two new models will likely ship by year's end. The article OpenAI will reportedly ship at least one model this year but its flagship still needs alignment work appeared first on The Decoder.