Sealbook
Sealbook / Open source / Agentes de IA y apps con LLM

ModelTC/LightLLM

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

deep-learninggptllamallmmodel-servingnlpopenai-triton
GitHub ↗

Licencia y mantenimiento

Apache-2.0 es una licencia permisiva: uso comercial libre con atribución.

Último cambio de código hoy.

Proyectos similares

RepositorioEstrellasLenguajeLicenciaActividad
1AiHubCN/Awesome-Chinese-LLM整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。★ 22.8k——Menos activo
2Significant-Gravitas/AutoGPTAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w★ 187.6kPythonOtherActivo
3ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.★ 183.7kGoMITActivo
4huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f★ 167.8kPythonApache-2.0Activo
5rasbt/LLMs-from-scratchImplement a ChatGPT-like LLM in PyTorch from scratch, step by step★ 106.8kJupyter NotebookOtherActivo
6vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs★ 94.1kPythonApache-2.0Activo
7OpenHands/OpenHands🙌 OpenHands: AI-Driven Development★ 91.2kTypeScriptMITActivo
8unslothai/unslothLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.★ 78.2kPythonApache-2.0Activo