Original titleYamz-Labs/kyojin
Kyojin is an inference engine for AMD Strix Halo built on ExLlamaV3 that runs 300B-class mixture-of-experts models on a single 128 GB mini PC.
Kyojin: the Yamz inference engine for AMD Strix Halo (ROCm, gfx1151), built on ExLlamaV3. Runs 300B-class MoE models on one 128 GB mini PC.
Anthropic introduced OSS Scanner, offering open-source projects free periodic security vulnerability scans using its strongest models. The service provides fast, frequent scans but without human review of the model-generated reports.
Amazon released TorchNeuron, a new development tool designed to reduce Nvidia's control over PyTorch, the free toolkit used to build most AI applications. The move aims to enable more developers to run AI workloads on alternative chips, including Amazon's own.
Deepseek released DeepInfer, the vLLM-based inference framework behind its V4.1-Flash model, as open-source software. The system cuts compute costs and energy use when running AI models, adding pricing pressure on Western providers like OpenAI and Anthropic.
Nvidia launched Minerva, an AIOps platform that combines telemetry from infrastructure and AI workloads and applies purpose-built AI models to deliver actionable insights. It helps teams identify problems early and keep AI factories productive.