Sealbook / Open source / AI agents & LLM apps

waybarrios/vllm-mlx

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

anthropicanthropic-apiapple-siliconclaude-codecontinuous-batchinginference-serverllmlocal-llmmacosmcp

GitHub ↗Website ↗

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 3 days ago.

Similar projects

	Repository	Stars	Language	License	Activity
1	affaan-m/ECCThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Code	★ 283.1k	JavaScript	MIT	Active
2	jundot/omlxLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar	★ 22.9k	Python	Apache-2.0	Active
3	JuliusBrussee/caveman🪨 why use many token when few token do trick. Viral skill + proxy for coding agents that cuts 65% of tokens by talking like a caveman.	★ 113.4k	Go	Apache-2.0	Active
4	rtk-ai/rtkCLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies	★ 83.9k	Rust	Apache-2.0	Active
5	can1357/oh-my-pi⌥ Coding agent with the IDE wired in. Built by Stencil Labs.	★ 35.8k	TypeScript	MIT	Active
6	tirth8205/code-review-graphLocal-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, wit	★ 32.2k	Python	MIT	Active
7	NousResearch/hermes-agentThe agent that grows with you	★ 254.9k	Python	MIT	Active
8	DietrichGebert/ponytailMakes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.	★ 166.9k	JavaScript	MIT	Active