SSealbook
Sealbook / Open source / AI agents & LLM apps

intentee/paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

aillamacppllmllmopsload-balancer
GitHub ↗Website ↗

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 4 days ago.

Similar projects

RepositoryStarsLanguageLicenseActivity
1khoj-ai/khojYour AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Tur★ 37.7kPythonAGPL-3.0Active
2firecrawl/firecrawlSupercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥★ 192.7kTypeScriptAGPL-3.0Active
3Significant-Gravitas/AutoGPTAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w★ 187.6kPythonOtherActive
4open-webui/open-webuiUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)★ 156.1kPythonOtherActive
5JuliusBrussee/caveman🪨 why use many token when few token do trick. Viral skill + proxy for coding agents that cuts 65% of tokens by talking like a caveman.★ 113.4kGoApache-2.0Active
6unclecode/crawl4aiOpen-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Clo★ 85.8kPythonApache-2.0Active
7unslothai/unslothLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.★ 78.2kPythonApache-2.0Active
8mem0ai/mem0The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.★ 67.4kPythonApache-2.0Active