intel/intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

4-bitsautoroundchatbotchatpdfgaudi3habanaintel-optimized-llamacpplarge-language-modelllm-cpullm-inference

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 2 years ago. Archived: read-only, no further updates.

	Repository	Stars	Language	License	Activity
1	nomic-ai/gpt4allGPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.	★ 77.3k	C++	MIT	Stale
2	asgeirtj/system_prompts_leaksDocumented system prompts from Anthropic - Claude Fable 5.1, Opus 5.5, Claude Design, Claude Code. OpenAI - ChatGPT GPT-6-Astra, Codex. Goog	★ 69.9k	Python	CC0-1.0	Active
3	xtekky/gpt4freeThe official gpt4free repository \| various collection of powerful language models \| opus 4.6 gpt 5.3 kimi 2.5 deepseek v3.2 gemini 3	★ 66.9k	Python	GPL-3.0	Active
4	FlowiseAI/FlowiseBuild AI Agents, Visually	★ 55.5k	TypeScript	Other	Archived
5	HKUDS/nanobotUltra-lightweight, open-source, self-hosted personal AI agent framework in Python with WebUI, tools, memory, MCP, multi-agent workflows, aut	★ 49.1k	Python	MIT	Active
6	ray-project/rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.	★ 44.1k	Python	Apache-2.0	Active
7	AstrBotDevs/AstrBotAI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alte	★ 42.1k	Python	AGPL-3.0	Active
8	chatboxai/chatboxPowerful AI Client	★ 42.1k	TypeScript	GPL-3.0	Active