Tencent releases Hy3 open-source model with 295B parameters
Tencent releases Hy3 open-source model that allegedly matches models up to five times its active size
The Decoder
Summary
Tencent released Hy3, a 295-billion-parameter open-source language model using a mixture-of-experts architecture. Only 21 billion parameters are active at any time. Tencent says Hy3 matches models two to five times its size while reducing hallucination rates to 5.4 percent.