Muse Glimmer 30B, an open-source agentic model for consumer devices
Original titleMuse Glimmer 30B: An On-Device Agentic Model
- Outlet
- arXiv
- Published
- Importance
- 3/5
- Trending
- 6
Summary
Muse Glimmer is an open-source 30B-parameter causal language model with perception encoder, designed to run on consumer hardware without cloud infrastructure. It accepts text and image inputs, was trained on over a hundred languages, and is quantized to approximately 4-bit precision for efficient single-GPU inference. It achieves state-of-the-art performance for its size on tool use, multi-step planning, and agentic task completion benchmarks.
Original excerpt
We introduce Muse Glimmer, an open-source 30B parameter causal language model with perception encoder, purpose-built for autonomous agentic tasks on consumer hardware. Muse Glimmer integrates multi-step reasoning, reliable tool use and failure recovery into a single model that runs locally on consumer devices without requiring cloud infrastructure. The model accepts text and image inputs and produces text outputs, was trained on data from over a hundred languages, and is quantized to approximately 4-bit precision for efficient single-GPU inference. Muse Glimmer achieves state-of-the-art performance for its size class on agentic benchmarks, setting a new standard compared to the models of its size: Gemma4-31B and Qwen3.6-27B on tool use, multi-step planning, and agentic task completion. We release the model under the Apache 2.0 license to foster open-source development of capable, safe, local AI agents.