b4rtaz/distributed-llama

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

distributed-computingdistributed-llmllama2llama3llmllm-inferencellmsneural-networkopen-llm

License & maintenance

MIT is a permissive license: free to use commercially with attribution.

Last code push 5 days ago.

	Repository	Stars	Language	License	Activity
1	ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.	★ 183.7k	Go	MIT	Active
2	open-webui/open-webuiUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)	★ 156.1k	Python	Other	Active
3	unslothai/unslothLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.	★ 78.2k	Python	Apache-2.0	Active
4	ray-project/rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.	★ 44.1k	Python	Apache-2.0	Active
5	khoj-ai/khojYour AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Tur	★ 37.7k	Python	AGPL-3.0	Active
6	microsoft/graphragA modular graph-based Retrieval-Augmented Generation (RAG) system	★ 36.4k	Python	MIT	Active
7	datawhalechina/self-llm《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程	★ 32.5k	Jupyter Notebook	Apache-2.0	Active
8	HandsOnLLM/Hands-On-Large-Language-ModelsOfficial code repo for the O'Reilly Book - "Hands-On Large Language Models"	★ 29.8k	Jupyter Notebook	Apache-2.0	Slowing