Zyphra says its hierarchical attention could speed long-context processing up to 35x

Summary

Zyphra unveiled Zyphra Hierarchical Attention (ZHA), a sparse attention technique that speeds up long-context processing. The method organizes information hierarchically and retrieves only the parts it needs instead of searching the whole document; the company projects up to 35x faster processing than standard attention on 10-million-token contexts.