TurboQuant
Explains TurboQuant, a rotation-based vector quantization method for KV-cache compression and vector search.
Explains TurboQuant, a rotation-based vector quantization method for KV-cache compression and vector search.
Explains how vectors relate to tensors in ML, including rank, framework terminology, and KV cache shapes.