xLLM-AI/xllm

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

deepseekglminferenceinference-enginelarge-language-modelsllm-inferenceqwen

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push today.

	Repository	Stars	Language	License	Activity
1	sgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models.	★ 37.3k	Python	Apache-2.0	Active
2	ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.	★ 183.7k	Go	MIT	Active
3	huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f	★ 167.8k	Python	Apache-2.0	Active
4	vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs	★ 94.1k	Python	Apache-2.0	Active
5	hiyouga/LlamaFactoryUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)	★ 75.6k	Python	Apache-2.0	Active
6	openinterpreter/openinterpreterA coding agent for open models like Kimi K3 and GLM 5.3	★ 68.6k	Rust	Apache-2.0	Active
7	ray-project/rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.	★ 44.1k	Python	Apache-2.0	Active
8	mindsdb/mindshubThe unified workspace where open-source models get things done for you.	★ 39.8k	Makefile	MIT	Active