Sealbook / Open source / Machine learning & data science

ModelCloud/GPTQModel

LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

gptqoptimumpeftquantizationsglangtransformersvllm

GitHub ↗Website ↗

License & maintenance

Custom or modified license that GitHub does not recognise: read the LICENSE file in the repository before using it in a product.

Last code push today.

Similar projects

	Repository	Stars	Language	License	Activity
1	lucidrains/vit-pytorchImplementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytor	★ 25.6k	Python	MIT	Active
2	huggingface/transformers.jsState-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!	★ 16.4k	JavaScript	Apache-2.0	Active
3	NielsRogge/Transformers-TutorialsThis repository contains demos I made with the Transformers library by HuggingFace.	★ 11.8k	Jupyter Notebook	MIT	Active
4	openclaw/openclawThe AI that really does things. Any OS. Any Platform. The lobster way. 🦞	★ 392.4k	TypeScript	MIT	Active
5	tensorflow/tensorflowAn Open Source Machine Learning Framework for Everyone	★ 201.1k	C++	Apache-2.0	Active
6	AUTOMATIC1111/stable-diffusion-webuiStable Diffusion web UI	★ 165.1k	Python	AGPL-3.0	Slowing
7	Comfy-Org/ComfyUIThe most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface. The fastest local inference engine in the w	★ 138.4k	Python	GPL-3.0	Active
8	openai/whisperRobust Speech Recognition via Large-Scale Weak Supervision	★ 110.8k	Python	MIT	Active