bytedance/lightseq

LightSeq: A High Performance Library for Sequence Processing and Generation

acceleratebartbeam-searchbertcudadiverse-decodinggptinferencemultilingual-nmtsampling

License & maintenance

Custom or modified license that GitHub does not recognise: read the LICENSE file in the repository before using it in a product.

Last code push 3 years ago. Archived: read-only, no further updates.

	Repository	Stars	Language	License	Activity
1	vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs	★ 94.1k	Python	Apache-2.0	Active
2	sgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models.	★ 37.3k	Python	Apache-2.0	Active
3	Significant-Gravitas/AutoGPTAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w	★ 187.6k	Python	Other	Active
4	langgenius/difyBuild Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-ho	★ 158.8k	Python	Other	Active
5	microsoft/generative-ai-for-beginners21 Lessons, Get Started Building with Generative AI	★ 121.6k	Jupyter Notebook	MIT	Active
6	rasbt/LLMs-from-scratchImplement a ChatGPT-like LLM in PyTorch from scratch, step by step	★ 106.8k	Jupyter Notebook	Other	Active
7	OpenHands/OpenHands🙌 OpenHands: AI-Driven Development	★ 91.2k	TypeScript	MIT	Active
8	hiyouga/LlamaFactoryUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)	★ 75.6k	Python	Apache-2.0	Active