Sealbook / Open source / Agentes de IA y apps con LLM

Tiiny-AI/PowerInfer

High-speed Large Language Model Serving for Local Deployment

large-language-modelsllamallmllm-inferencelocal-inference

Licencia y mantenimiento

MIT es una licencia permisiva: uso comercial libre con atribución.

Último cambio de código hace 5 meses.

Proyectos similares

	Repositorio	Estrellas	Lenguaje	Licencia	Actividad
1	ray-project/rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.	★ 44.1k	Python	Apache-2.0	Activo
2	ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.	★ 183.7k	Go	MIT	Activo
3	unslothai/unslothLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.	★ 78.2k	Python	Apache-2.0	Activo
4	hiyouga/LlamaFactoryUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)	★ 75.6k	Python	Apache-2.0	Activo
5	bojieli/ai-agent-book《深入理解 AI Agent：设计原理与工程实践》（李博杰著）开源主仓库：全书正文、编译版 PDF 与按章配套代码	★ 54.8k	Python	Apache-2.0	Activo
6	mudler/LocalAILocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.	★ 49.6k	Go	MIT	Activo
7	HKUDS/LightRAG[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation	★ 40.2k	Python	MIT	Activo
8	lyogavin/airllmAirLLM 2.8T LLM inference with single 4GB GPU	★ 39.3k	Jupyter Notebook	Apache-2.0	Activo