Sealbook / Open source / AI agents & LLM apps

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

amdblackwellcudadeepseekdeepseek-v3gptgpt-ossinferencekimillama

GitHub ↗Website ↗

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push today.

Similar projects

	Repository	Stars	Language	License	Activity
1	sgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models.	★ 37.3k	Python	Apache-2.0	Active
2	ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.	★ 183.7k	Go	MIT	Active
3	hiyouga/LlamaFactoryUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)	★ 75.6k	Python	Apache-2.0	Active
4	langgenius/difyBuild Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-ho	★ 158.8k	Python	Other	Active
5	unslothai/unslothLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.	★ 78.2k	Python	Apache-2.0	Active
6	openinterpreter/openinterpreterA coding agent for open models like Kimi K3 and GLM 5.3	★ 68.6k	Rust	Apache-2.0	Active
7	chatanywhere/GPT_API_free免费大模型API，支持免费调用GPT、DeepSeek等主流模型，免费额度10000点，每日刷新！另付费价格最低官方1-2折！	★ 44.4k	—	MIT	Active
8	AstrBotDevs/AstrBotAI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alte	★ 42.1k	Python	AGPL-3.0	Active