Kakao presents MoE optimization and model compression research at COLM 2026
Original article in Korean카카오, 국제 AI 학회서 MoE 학습 최적화·모델 경량화 성과 공개
- Outlet
- AI Times
- Published
- Importance
- 3/5
Summary
Kakao presented at the COLM 2026 conference a method to predict optimal learning rates for large mixture-of-experts model pretraining at approximately 1% of total training cost. The company also shared model compression research at the TokShop tokenization workshop.