huggingface/text-generation-inference

Large Language Model Text Generation Inference

bloomdeep-learningfalcongptinferencenlppytorchstarcodertransformer

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 7 months ago. Archived: read-only, no further updates.

	Repository	Stars	Language	License	Activity
1	SYSTRAN/faster-whisperFaster Whisper transcription with CTranslate2	★ 25.9k	Python	MIT	Active
2	rasbt/LLMs-from-scratchImplement a ChatGPT-like LLM in PyTorch from scratch, step by step	★ 106.8k	Jupyter Notebook	Other	Active
3	vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs	★ 94.1k	Python	Apache-2.0	Active
4	ggml-org/whisper.cppPort of OpenAI's Whisper model in C/C++	★ 54.5k	C++	MIT	Active
5	lukasmasuch/best-of-ml-python🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.	★ 23.8k	—	CC-BY-SA-4.0	Active
6	Significant-Gravitas/AutoGPTAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w	★ 187.6k	Python	Other	Active
7	huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f	★ 167.8k	Python	Apache-2.0	Active
8	langgenius/difyBuild Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-ho	★ 158.8k	Python	Other	Active