SSealbook
Sealbook / Open source / Agentes de IA y apps con LLM

xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

artificial-intelligencediffusersgemmaglmglm-5-3inferencekimikimi-k3llama-cppllamacpp
GitHub ↗Sitio ↗

Licencia y mantenimiento

Apache-2.0 es una licencia permisiva: uso comercial libre con atribución.

Último cambio de código hoy.

Proyectos similares

RepositorioEstrellasLenguajeLicenciaActividad
1ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.★ 183.7kGoMITActivo
2huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f★ 167.8kPythonApache-2.0Activo
3vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs★ 94.1kPythonApache-2.0Activo
4sgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models.★ 37.3kPythonApache-2.0Activo
5Significant-Gravitas/AutoGPTAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w★ 187.6kPythonOtherActivo
6rasbt/LLMs-from-scratchImplement a ChatGPT-like LLM in PyTorch from scratch, step by step★ 106.8kJupyter NotebookOtherActivo
7thedotmack/claude-memPersistent Context Across Sessions for Every Agent – Captures everything your agent does during sessions, compresses it with AI, and inject★ 101.6kTypeScriptApache-2.0Activo
8OpenHands/OpenHands🙌 OpenHands: AI-Driven Development★ 91.2kTypeScriptMITActivo