PaddlePaddle/FastDeploy

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

ernieernie-45ernie-45-vlinferencellmllm-servingopenaiservingvllm

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 25 days ago.

	Repository	Stars	Language	License	Activity
1	Significant-Gravitas/AutoGPTAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w	★ 187.6k	Python	Other	Active
2	open-webui/open-webuiUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)	★ 156.1k	Python	Other	Active
3	OpenHands/OpenHands🙌 OpenHands: AI-Driven Development	★ 91.2k	TypeScript	MIT	Active
4	ggml-org/whisper.cppPort of OpenAI's Whisper model in C/C++	★ 54.5k	C++	MIT	Active
5	ray-project/rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.	★ 44.1k	Python	Apache-2.0	Active
6	sgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models.	★ 37.3k	Python	Apache-2.0	Active
7	openai/openai-agents-pythonA lightweight, powerful framework for multi-agent workflows	★ 30.1k	Python	MIT	Active
8	labring/FastGPTFastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing	★ 29.9k	TypeScript	Other	Active