bigscience-workshop/petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

bloomchatbotdeep-learningdistributed-systemsfalcongptguanacolanguage-modelslarge-language-modelsllama

License & maintenance

MIT is a permissive license: free to use commercially with attribution.

Last code push 2 years ago.

	Repository	Stars	Language	License	Activity
1	hiyouga/LlamaFactoryUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)	★ 75.6k	Python	Apache-2.0	Active
2	AstrBotDevs/AstrBotAI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alte	★ 42.1k	Python	AGPL-3.0	Active
3	rasbt/LLMs-from-scratchImplement a ChatGPT-like LLM in PyTorch from scratch, step by step	★ 106.8k	Jupyter Notebook	Other	Active
4	vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs	★ 94.1k	Python	Apache-2.0	Active
5	FlowiseAI/FlowiseBuild AI Agents, Visually	★ 55.5k	TypeScript	Other	Archived
6	ray-project/rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.	★ 44.1k	Python	Apache-2.0	Active
7	chatboxai/chatboxPowerful AI Client	★ 42.1k	TypeScript	GPL-3.0	Active
8	HKUDS/LightRAG[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation	★ 40.2k	Python	MIT	Active