Sealbook
Sealbook / Open source / AI agents & LLM apps

intel/neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

auto-tuningawqfp4gptqint4int8knowledge-distillationlarge-language-modelslow-precisionmxformat
GitHub ↗Website ↗

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 4 days ago.

Similar projects

RepositoryStarsLanguageLicenseActivity
1langflow-ai/langflowLangflow is a powerful tool for building and deploying AI-powered agents and workflows.★ 155.8kPythonMITActive
2hiyouga/LlamaFactoryUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)★ 75.6kPythonApache-2.0Active
3binary-husky/gpt_academic为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入★ 71.5kPythonGPL-3.0Slowing
4FlowiseAI/FlowiseBuild AI Agents, Visually★ 55.5kTypeScriptOtherArchived
5bojieli/ai-agent-book《深入理解 AI Agent：设计原理与工程实践》（李博杰 著）开源主仓库：全书正文、编译版 PDF 与按章配套代码★ 54.8kPythonApache-2.0Active
6ray-project/rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.★ 44.1kPythonApache-2.0Active
7HKUDS/LightRAG[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation★ 40.2kPythonMITActive
8google/langextractA Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visua★ 39kPythonApache-2.0Active