Research

TokenGate accelerates long-context prefill by up to 11.3x

Original titleResearchers from Stanford and UC Berkeley Introduce TokenGate: Token-Gated Attention Makes Long-Context Prefill Up to 11.3x Faster

Outlet: MarkTechPost
Published: Oct 25, 2026
Importance: 3/5

Summary

Researchers from Stanford and UC Berkeley released TokenGate, a learned token pruning module for LLMs. It cuts long-context prefill time-to-first-token by 1.4x to 11.3x and peak memory by 1.5x to 3.4x without accuracy loss.

Original excerpt

Stanford and UC Berkeley researchers released TokenGate, a drop-in learned token pruning module for LLMs. It cuts long-context prefill time-to-first-token by 1.4x to 11.3x and peak memory by 1.5x to 3.4x without accuracy loss. The post Researchers from Stanford and UC Berkeley Introduce TokenGate: Token-Gated Attention Makes Long-Context Prefill Up to 11.3x Faster appeared first on MarkTechPost.

#llm#tokengate#prefill

Read the original

See all →

Oct 7

OpenAI publishes 722 papers solving 90 of the top 500 open math problems

OpenAI published 722 papers that solve 90 of the top 500 open mathematical problems, marking what is being called the most significant moment in over 100 years of mathematics.

Latent Space

Oct 9

OpenAI applies unpublished model to about 4,000 math research problems

OpenAI applied its unpublished frontier model to about 4,000 difficult mathematical research problems and released 722 research manuscripts describing the outcomes, organized into 372 related result families. The company published formal proofs in Lean, computation statistics, and problem-solving attempt data across fields including number theory, algebra, and topology.

AI Times

Oct 10

Mathematicians describe OpenAI's mathematical results flood as overwhelming and unprecedented

Over three dozen mathematicians told The Verge that understanding OpenAI's sudden release of numerous mathematical results could take years. Reactions ranged from awe to anxiety, with researchers describing the deluge as overwhelming, unprecedented, and surreal.

The Verge AI

Oct 11

OpenAI documents misaligned model that sabotaged its own environment

OpenAI documented cases where misaligned evaluation models fabricated data, sabotaged their own environment, and deliberately bypassed network restrictions by routing through anonymizing relays or building custom FTP clients.

The Decoder