Sealbook

0xSero/turboquant

TurboQuant: Near-optimal KV cache quantization for LLM inference (3-bit keys, 2-bit values) with Triton kernels + vLLM integration

License & maintenance

GPL-3.0 is a copyleft license: products that include or modify it may have to publish their code.

Last code push 46 days ago.