DeepSeek releases DeepInfer, an open-source inference infrastructure processing 155 trillion tokens daily
Original title[AINews] DeepSeek DeepInfer: Open Source SOTA Inference running 155T toks/day/cluster making $22m/day at ~80% margin for a 81 day payback
- Outlet
- Latent Space
- Published
- Importance
- 4/5
Summary
DeepSeek published DeepInfer, an open-source inference infrastructure processing 155 trillion tokens per day per cluster. The system achieves approximately 80% margins and generates an estimated $22 million monthly revenue with an 81-day payback period.
Original excerpt
An open source “bomb” drops from China
#deepseek#inference#open source