Original titleDeepInfer: High-performance inference framework for DeepSeek models
DeepInfer is a high-performance inference framework designed for DeepSeek models.
Anthropic introduced OSS Scanner, offering open-source projects free periodic security vulnerability scans using its strongest models. The service provides fast, frequent scans but without human review of the model-generated reports.
Amazon released TorchNeuron, a new development tool designed to reduce Nvidia's control over PyTorch, the free toolkit used to build most AI applications. The move aims to enable more developers to run AI workloads on alternative chips, including Amazon's own.
Deepseek released DeepInfer, the vLLM-based inference framework behind its V4.1-Flash model, as open-source software. The system cuts compute costs and energy use when running AI models, adding pricing pressure on Western providers like OpenAI and Anthropic.
Nvidia launched Minerva, an AIOps platform that combines telemetry from infrastructure and AI workloads and applies purpose-built AI models to deliver actionable insights. It helps teams identify problems early and keep AI factories productive.