dvmazur/mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops

colab-notebookdeep-learninggoogle-colablanguage-modelllmmixture-of-expertsoffloadingpytorchquantization

License & maintenance

MIT is a permissive license: free to use commercially with attribution.

Last code push 2 years ago.

	Repository	Stars	Language	License	Activity
1	huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f	★ 167.8k	Python	Apache-2.0	Active
2	rasbt/LLMs-from-scratchImplement a ChatGPT-like LLM in PyTorch from scratch, step by step	★ 106.8k	Jupyter Notebook	Other	Active
3	dair-ai/Prompt-Engineering-Guide🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.	★ 79.3k	MDX	MIT	Slowing
4	ray-project/rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.	★ 44.1k	Python	Apache-2.0	Active
5	vercel/aiThe AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications a	★ 27.4k	TypeScript	Other	Active
6	SYSTRAN/faster-whisperFaster Whisper transcription with CTranslate2	★ 25.9k	Python	MIT	Active
7	AccumulateMore/CV✅（已完结）超级全面的深度学习笔记【土堆 Pytorch】【李沐动手学深度学习】【吴恩达深度学习】【大飞大模型Agent】	★ 24.1k	Jupyter Notebook	—	Active
8	mlc-ai/mlc-llmUniversal LLM Deployment Engine with ML Compilation	★ 23.3k	Python	Apache-2.0	Active