RahulSChand/gpu_poor

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

ggmlgpuhuggingfacelanguage-modelllamallama2llamacppllmpytorchquantization

Licencia y mantenimiento

Sin licencia indicada: por defecto nadie puede reutilizar el código. Pregunta a los autores antes de usarlo en un producto.

Último cambio de código hace 22 meses.

	Repositorio	Estrellas	Lenguaje	Licencia	Actividad
1	ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.	★ 183.7k	Go	MIT	Activo
2	unslothai/unslothLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.	★ 78.2k	Python	Apache-2.0	Activo
3	mudler/LocalAILocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.	★ 49.6k	Go	MIT	Activo
4	janhq/janJan is an open source alternative to ChatGPT that runs 100% offline on your computer.	★ 45k	Rust	Other	Activo
5	lyogavin/airllmAirLLM 2.8T LLM inference with single 4GB GPU	★ 39.3k	Jupyter Notebook	Apache-2.0	Activo
6	khoj-ai/khojYour AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Tur	★ 37.7k	Python	AGPL-3.0	Activo
7	sgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models.	★ 37.3k	Python	Apache-2.0	Activo
8	vercel/aiThe AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications a	★ 27.4k	TypeScript	Other	Activo