Meta releases Muse Spark Open, an 816B open-weight MoE model with 1M context
Original titleMeta Releases Muse Spark Open: 816B Open-Weight MoE With 1M Context
- Outlet
- MarkTechPost
- Published
- Importance
- 5/5
Summary
Meta released Muse Spark Open, an 816B-parameter open-weight mixture-of-experts model with 42B active parameters and 1M-token context. It leads on open-model benchmarks and runs on 2 M5 Ultra Mac Studios.
Original excerpt
Meta released Muse Spark Open, an 816B-parameter open-weight MoE model with 42B active parameters and a 1M-token context. It leads open models on MCP-Atlas and runs on 2 M5 Ultra Mac Studios. The post Meta Releases Muse Spark Open: 816B Open-Weight MoE With 1M Context appeared first on MarkTechPost.
#llm#meta#moe