scrya-com/rotorquant
KV cache compression via block-diagonal rotation. Beats TurboQuant: better PPL (6.91 vs 7.07), 28% faster decode, 5.3x faster prefill, 44x fewer params. Drop-in llama.cpp integration.
License & maintenance
No license stated: by default nobody may reuse the code. Ask the authors before using it in a product.
Last code push 5 months ago.
Similar projects
| Repository | Stars | Activity | |
|---|---|---|---|
| 1 |  996icu/996.ICURepo for counting stars and contributing. Press F to pay respect to glorious developers. | ★ 277.2k | Stale |
| 2 |  torvalds/linuxLinux kernel source tree | ★ 252.4k | Active |
| 3 |  jackfrued/Python-100-DaysPython - 100天从新手到大师 | ★ 187.3k | Active |
| 4 |  airbnb/javascriptJavaScript Style Guide | ★ 148.1k | Slowing |
| 5 |  iptv-org/iptvCollection of publicly available IPTV channels from all over the world | ★ 141.3k | Active |
| 6 |  ruanyf/weekly科技爱好者周刊，每周五发布 | ★ 106.4k | Active |
| 7 |  deepseek-ai/DeepSeek-V3 | ★ 104.5k | Stale |
| 8 |  Anduin2017/HowToCookProgrammer's guide about how to cook at home. | ★ 102.9k | Active |