tonbistudio/turboquant-pytorch
From-scratch PyTorch implementation of Google's TurboQuant (ICLR 2026) for LLM KV cache compression. 5x compression at 3-bit with 99.5% attention fidelity.
License & maintenance
MIT is a permissive license: free to use commercially with attribution.
Last code push 5 months ago.