Tessera, an LLM distillation and serving engine with custom CUDA kernels
zengxiao-he/tessera
GitHubTrending 8
Summary
Tessera is a from-scratch LLM distillation and serving engine featuring custom Triton and CUDA kernels, FSDP distillation, paged-KV continuous batching, speculative decoding, a Rust gateway, and JAX oracle tools.