vllm-project/vllm-ascend

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push today.

Similar projects

	Repository	Stars	Language	License	Activity
1	liguodongiot/llm-action本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）	★ 25.2k	HTML	Apache-2.0	Active
2	BerriAI/litellmThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, l	★ 61.5k	Python	Other	Active
3	ggml-org/whisper.cppPort of OpenAI's Whisper model in C/C++	★ 54.5k	C++	MIT	Active
4	ray-project/rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.	★ 44.1k	Python	Apache-2.0	Active
5	sgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models.	★ 37.3k	Python	Apache-2.0	Active
6	langfuse/langfuse🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.	★ 36k	TypeScript	Other	Active
7	p-e-w/hereticFully automatic censorship removal for language models	★ 35.7k	Python	AGPL-3.0	Active
8	promptfoo/promptfooTest your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepS	★ 26.1k	TypeScript	MIT	Active