Sealbook / Open source / AI agents & LLM apps

thu-ml/SageAttention

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

attentioncudaefficient-attentioninference-accelerationllmllm-inframlsysquantizationtritonvideo-generate

GitHub ↗Website ↗

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 9 months ago.

Similar projects

	Repository	Stars	Language	License	Activity
1	sgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models.	★ 37.3k	Python	Apache-2.0	Active
2	affaan-m/ECCThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Code	★ 283.1k	JavaScript	MIT	Active
3	firecrawl/firecrawlSupercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥	★ 192.7k	TypeScript	AGPL-3.0	Active
4	Significant-Gravitas/AutoGPTAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w	★ 187.6k	Python	Other	Active
5	ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.	★ 183.7k	Go	MIT	Active
6	huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f	★ 167.8k	Python	Apache-2.0	Active
7	DietrichGebert/ponytailMakes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.	★ 166.9k	JavaScript	MIT	Active
8	open-webui/open-webuiUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)	★ 156.1k	Python	Other	Active