AI Daybook
한국어
AI Daybook
Today's issue
Agents

Anthropic's Message Threads cut time to first token by 35 percent for long conversations

Outlet
The Decoder
Published
Importance
4/5

Summary

Anthropic released Message Threads for the Messages API, which allows agents to transmit only changes instead of resending entire conversations. For requests between 500,000 and one million tokens, time to first token drops by approximately 35 percent.

Follow-up coverage

  1. This story
  2. Follow-upThe Decoder1 day laterAnthropic releases FlashProve to verify which model generated an AI response

Original excerpt

Anthropic released Message Threads for the Messages API. Instead of resending the entire conversation with every turn, agents now only transmit what's changed. For requests between 500,000 and one million tokens, time to first token drops by about 35 percent. The article Anthropic's Message Threads cut time to first token by 35 percent for long conversations appeared first on The Decoder.

#anthropic#api#optimization#streaming
Read the original
See all →
Oct 11

AI agents learn to decompile a first-person shooter with 500 billion tokens

AI agents were trained on 500 billion tokens to decompile a first-person shooter game.

Hacker NewsTrending 55
Jul 6

JADEPUFFER is the first agentic ransomware operation

Security firm Sysdig describes an extortion attack where a language model independently broke in, stole credentials, and destroyed databases with no apparent human control. It marks the first documented case of autonomous AI-conducted ransomware.

The Decoder
Oct 10

Anthropic's Claude orchestrates up to 1,000 AI agents in parallel through dynamic workflows

Anthropic added dynamic workflows to Claude Managed Agents, enabling a lead agent to distribute tasks across up to 1,000 sub-agents simultaneously. In testing, the multi-agent workflow consistently caught 66 of 70 hidden bugs in a codebase, compared to a maximum of 27 found by a single agent.

The Decoder
Oct 12

AI agent teams waste tokens for barely measurable quality gains, research finds

According to research by Vals AI, teams of AI agents cost up to 5.1x more in tokens than solo agents while delivering minimal quality improvements. Only one of four tests with GPT-6 Sol and Claude Opus 5.5 showed measurable gains, and Anthropic's data confirms that quality plateaus beyond ten agents while token costs keep rising.

The Decoder +1 more
Read the original