turboderp/exllama
A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
License & maintenance
MIT is a permissive license: free to use commercially with attribution.
Last code push 3 years ago.
Similar projects
| Repository | Stars | Activity | |
|---|---|---|---|
| 1 |  996icu/996.ICURepo for counting stars and contributing. Press F to pay respect to glorious developers. | ★ 277.2k | Stale |
| 2 |  torvalds/linuxLinux kernel source tree | ★ 252.4k | Active |
| 3 |  jackfrued/Python-100-DaysPython - 100天从新手到大师 | ★ 187.3k | Active |
| 4 |  airbnb/javascriptJavaScript Style Guide | ★ 148.1k | Slowing |
| 5 |  iptv-org/iptvCollection of publicly available IPTV channels from all over the world | ★ 141.3k | Active |
| 6 |  ruanyf/weekly科技爱好者周刊，每周五发布 | ★ 106.4k | Active |
| 7 |  deepseek-ai/DeepSeek-V3 | ★ 104.5k | Stale |
| 8 |  Anduin2017/HowToCookProgrammer's guide about how to cook at home. | ★ 102.9k | Active |