What is Speculative Decoding?

Explains speculative decoding, which pairs a small draft model with a large target model to accelerate LLM inference without changing outputs.

June 24, 2026 · 2 min

Prefix Caching in AI

Explains prefix caching for reusing attention KV computations to speed up shared-prefix AI inference.

June 17, 2026 · 1 min