SSealbook
Sealbook / Open source / AI agents & LLM apps

microsoft/LLMLingua

[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

GitHub ↗Website ↗

License & maintenance

MIT is a permissive license: free to use commercially with attribution.

Last code push 39 days ago.

Similar projects

RepositoryStarsLanguageLicenseActivity
1morluto/reaReverse engineer anything with agents, from app behavior down to native binaries.★ 319.5kTypeScriptMITActive
2mattpocock/skillsSkills for Real Engineers. Straight from my .agents directory.★ 296kShellMITActive
3affaan-m/ECCThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Code★ 283.1kJavaScriptMITActive
4NousResearch/hermes-agentThe agent that grows with you★ 254.9kPythonMITActive
5deepseek-ai/deepseek-harnessDeepSeek Harness: Everything is a Plugin.★ 253kTypeScriptMITActive
6multica-ai/andrej-karpathy-skillsA single CLAUDE.md file to improve Claude Code behavior, derived from Andrej Karpathy's observations on LLM coding pitfalls.★ 220.9k——Slowing
7anomalyco/opencodeThe open source coding agent.★ 216.3kTypeScriptMITActive
8n8n-io/n8nFair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integ★ 207.9kTypeScriptOtherActive