SSealbook
Sealbook / Open source / AI agents & LLM apps

BerriAI/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmops
GitHub ↗Website ↗

License & maintenance

Custom or modified license that GitHub does not recognise: read the LICENSE file in the repository before using it in a product.

Last code push today.

Similar projects

RepositoryStarsLanguageLicenseActivity
1langfuse/langfuse🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.★ 36kTypeScriptOtherActive
2comet-ml/opikDebug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, an★ 22.7kPythonApache-2.0Active
3affaan-m/ECCThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Code★ 283.1kJavaScriptMITActive
4JuliusBrussee/caveman🪨 why use many token when few token do trick. Viral skill + proxy for coding agents that cuts 65% of tokens by talking like a caveman.★ 113.4kGoApache-2.0Active
5rtk-ai/rtkCLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies★ 83.9kRustApache-2.0Active
6diegosouzapw/OmniRouteNever stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, Min★ 78kTypeScriptMITActive
7headroomlabs-ai/headroomCompress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JS★ 75.8kPythonApache-2.0Active
8can1357/oh-my-pi⌥ Coding agent with the IDE wired in. Built by Stencil Labs.★ 35.8kTypeScriptMITActive