Sealbook / Open source / Agentes de IA y apps con LLM

LMCache/LMCache

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

amdcudafastinferencekv-cachellmpytorchrocmspeedvllm

GitHub ↗Sitio ↗

Licencia y mantenimiento

Apache-2.0 es una licencia permisiva: uso comercial libre con atribución.

Último cambio de código hoy.

Proyectos similares

	Repositorio	Estrellas	Lenguaje	Licencia	Actividad
1	vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs	★ 94.1k	Python	Apache-2.0	Activo
2	sgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models.	★ 37.3k	Python	Apache-2.0	Activo
3	huggingface/peft🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.	★ 21.8k	Python	Apache-2.0	Activo
4	affaan-m/ECCThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Code	★ 283.1k	JavaScript	MIT	Activo
5	firecrawl/firecrawlSupercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥	★ 192.7k	TypeScript	AGPL-3.0	Activo
6	Significant-Gravitas/AutoGPTAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w	★ 187.6k	Python	Other	Activo
7	ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.	★ 183.7k	Go	MIT	Activo
8	huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f	★ 167.8k	Python	Apache-2.0	Activo