Prime Intellect releases Prime Mega MoE, speeds up Qwen3 MoE training by up to 34%
Original titlePrime Intellect Releases Prime Mega MoE: Trainable Fused MoE Kernel, 3.11x Faster Forward Pass
- Outlet
- MarkTechPost
- Published
- Importance
- 3/5
Summary
Prime Intellect released Prime Mega MoE, a backward pass for DeepSeek's fused Mega MoE kernel that makes it trainable. The tool speeds Qwen3 MoE training steps by up to 34% in prime-rl and delivers up to a 3.11x faster forward pass.
Original excerpt
Prime Intellect released Prime Mega MoE, a backward pass for DeepSeek’s fused Mega MoE kernel. It makes the kernel trainable and speeds Qwen3 MoE training steps by up to 34% in prime-rl. The post Prime Intellect Releases Prime Mega MoE: Trainable Fused MoE Kernel, 3.11x Faster Forward Pass appeared first on MarkTechPost.
#training#moe#prime-intellect