predibase/lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

fine-tuninggptllamallmllm-inferencellm-servingllmopsloramodel-servingpytorch

Licencia y mantenimiento

Apache-2.0 es una licencia permisiva: uso comercial libre con atribución.

Último cambio de código hace 4 meses. Archivado: solo lectura, sin más actualizaciones.

	Repositorio	Estrellas	Lenguaje	Licencia	Actividad
1	liguodongiot/llm-action本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）	★ 25.2k	HTML	Apache-2.0	Activo
2	huggingface/peft🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.	★ 21.8k	Python	Apache-2.0	Activo
3	unslothai/unslothLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.	★ 78.2k	Python	Apache-2.0	Activo
4	hiyouga/LlamaFactoryUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)	★ 75.6k	Python	Apache-2.0	Activo
5	ray-project/rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.	★ 44.1k	Python	Apache-2.0	Activo
6	lyogavin/airllmAirLLM 2.8T LLM inference with single 4GB GPU	★ 39.3k	Jupyter Notebook	Apache-2.0	Activo
7	Significant-Gravitas/AutoGPTAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w	★ 187.6k	Python	Other	Activo
8	ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.	★ 183.7k	Go	MIT	Activo