Sealbook / Open source / AI agents & LLM apps

ModelTC/LightLLM

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

deep-learninggptllamallmmodel-servingnlpopenai-triton

GitHub ↗

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push today.

Similar projects

	Repository	Stars	Language	License	Activity
1	AiHubCN/Awesome-Chinese-LLM整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。	★ 22.8k	—	—	Slowing
2	Significant-Gravitas/AutoGPTAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w	★ 187.6k	Python	Other	Active
3	ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.	★ 183.7k	Go	MIT	Active
4	huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f	★ 167.8k	Python	Apache-2.0	Active
5	rasbt/LLMs-from-scratchImplement a ChatGPT-like LLM in PyTorch from scratch, step by step	★ 106.8k	Jupyter Notebook	Other	Active
6	vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs	★ 94.1k	Python	Apache-2.0	Active
7	OpenHands/OpenHands🙌 OpenHands: AI-Driven Development	★ 91.2k	TypeScript	MIT	Active
8	unslothai/unslothLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.	★ 78.2k	Python	Apache-2.0	Active