Sealbook / Open source / AI agents & LLM apps

wangzhaode/mnn-llm

llm deploy project based mnn. This project has merged into MNN.

baichuan2-7bchatglm-6bchatglm2-6bcodegeex2-6bcppcudamnnopenclqwen-7b

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 21 months ago.

Similar projects

	Repository	Stars	Language	License	Activity
1	vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs	★ 94.1k	Python	Apache-2.0	Active
2	binary-husky/gpt_academic为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入	★ 71.5k	Python	GPL-3.0	Slowing
3	sgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models.	★ 37.3k	Python	Apache-2.0	Active
4	Fincept-Corporation/FinceptTerminalFinceptTerminal is a modern finance application offering advanced market analytics, investment research, and economic data tools, designed f	★ 32.7k	C++	Other	Active
5	morluto/reaReverse engineer anything with agents, from app behavior down to native binaries.	★ 319.5k	TypeScript	MIT	Active
6	mattpocock/skillsSkills for Real Engineers. Straight from my .agents directory.	★ 296k	Shell	MIT	Active
7	affaan-m/ECCThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Code	★ 283.1k	JavaScript	MIT	Active
8	NousResearch/hermes-agentThe agent that grows with you	★ 254.9k	Python	MIT	Active