FMInference/FlexLLMGen

Running large language models on a single GPU for throughput-oriented scenarios.

deep-learninggpt-3high-throughputlarge-language-modelsmachine-learningoffloadingopt

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 24 months ago. Archived: read-only, no further updates.

	Repository	Stars	Language	License	Activity
1	stefan-jansen/machine-learning-for-tradingCode for Machine Learning for Trading, 3rd edition — from data sourcing to live execution.	★ 21.4k	Jupyter Notebook	MIT	Active
2	huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f	★ 167.8k	Python	Apache-2.0	Active
3	ray-project/rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.	★ 44.1k	Python	Apache-2.0	Active
4	lukasmasuch/best-of-ml-python🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.	★ 23.8k	—	CC-BY-SA-4.0	Active
5	huggingface/datasets🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools	★ 22.1k	Python	Apache-2.0	Active
6	langflow-ai/langflowLangflow is a powerful tool for building and deploying AI-powered agents and workflows.	★ 155.8k	Python	MIT	Active
7	rasbt/LLMs-from-scratchImplement a ChatGPT-like LLM in PyTorch from scratch, step by step	★ 106.8k	Jupyter Notebook	Other	Active
8	dair-ai/Prompt-Engineering-Guide🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.	★ 79.3k	MDX	MIT	Slowing