Sealbook

thu-pacman/chitu

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

deepseekgpullmllm-servingmodel-servingpytorch

Licencia y mantenimiento

Apache-2.0 es una licencia permisiva: uso comercial libre con atribución.

Último cambio de código hace 6 días.

Proyectos similares

RepositorioEstrellasLenguajeLicenciaActividad
1ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.★ 183.7kGoMITActivo
2huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f★ 167.8kPythonApache-2.0Activo
3unslothai/unslothLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.★ 78.2kPythonApache-2.0Activo
4ray-project/rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.★ 44.1kPythonApache-2.0Activo
5sgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models.★ 37.3kPythonApache-2.0Activo
6labring/FastGPTFastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing★ 29.9kTypeScriptOtherActivo
7liguodongiot/llm-action本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)★ 25.2kHTMLApache-2.0Activo
8Ebony-Vinyl/dsh-our-free-model在 dsh 里装上这个插件即可,无需登录、注册或填 API Key,就能使用包括 DeepSeek V4.1 Flash、Kimi K3 在内的前沿模型——完全免费,不限量。 All you do is install this plugin in dsh: no login, ★ 24.6kJavaScriptMITActivo