vllm-project/semantic-router

An open, programmable decision layer for models and compute.

ai-gatewayguardrailsinferencekubernetesllmllmroutermixture-of-modelspytorchsemantic-routertransformer

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push today.

	Repository	Stars	Language	License	Activity
1	BerriAI/litellmThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, l	★ 61.5k	Python	Other	Active
2	ggml-org/whisper.cppPort of OpenAI's Whisper model in C/C++	★ 54.5k	C++	MIT	Active
3	Kong/kong🦍 The API and AI Gateway	★ 44.3k	Lua	Apache-2.0	Active
4	sgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models.	★ 37.3k	Python	Apache-2.0	Active
5	p-e-w/hereticFully automatic censorship removal for language models	★ 35.7k	Python	AGPL-3.0	Active
6	SYSTRAN/faster-whisperFaster Whisper transcription with CTranslate2	★ 25.9k	Python	MIT	Active
7	huggingface/peft🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.	★ 21.8k	Python	Apache-2.0	Active
8	affaan-m/ECCThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Code	★ 283.1k	JavaScript	MIT	Active