Sealbook
Sealbook / Open source / Agentes de IA y apps con LLM

thu-ml/SageAttention

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

attentioncudaefficient-attentioninference-accelerationllmllm-inframlsysquantizationtritonvideo-generate
GitHub ↗Sitio ↗

Licencia y mantenimiento

Apache-2.0 es una licencia permisiva: uso comercial libre con atribución.

Último cambio de código hace 9 meses.

Proyectos similares

RepositorioEstrellasLenguajeLicenciaActividad
1sgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models.★ 37.3kPythonApache-2.0Activo
2affaan-m/ECCThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Code★ 283.1kJavaScriptMITActivo
3firecrawl/firecrawlSupercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥★ 192.7kTypeScriptAGPL-3.0Activo
4Significant-Gravitas/AutoGPTAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w★ 187.6kPythonOtherActivo
5ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.★ 183.7kGoMITActivo
6huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f★ 167.8kPythonApache-2.0Activo
7DietrichGebert/ponytailMakes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.★ 166.9kJavaScriptMITActivo
8open-webui/open-webuiUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)★ 156.1kPythonOtherActivo