bentoml/BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

ai-inferencedeep-learninggenerative-aiinference-platformllmllm-inferencellm-servingllmopsmachine-learningml-engineering

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 13 days ago.

	Repository	Stars	Language	License	Activity
1	ray-project/rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.	★ 44.1k	Python	Apache-2.0	Active
2	liguodongiot/llm-action本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）	★ 25.2k	HTML	Apache-2.0	Active
3	huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f	★ 167.8k	Python	Apache-2.0	Active
4	huggingface/datasets🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools	★ 22.1k	Python	Apache-2.0	Active
5	rasbt/LLMs-from-scratchImplement a ChatGPT-like LLM in PyTorch from scratch, step by step	★ 106.8k	Jupyter Notebook	Other	Active
6	dair-ai/Prompt-Engineering-Guide🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.	★ 79.3k	MDX	MIT	Slowing
7	BerriAI/litellmThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, l	★ 61.5k	Python	Other	Active
8	paperless-ngx/paperless-ngxA community-supported supercharged document management system: scan, index and archive all your documents	★ 46.8k	Python	GPL-3.0	Active