huggingface/tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

bertgptlanguage-modelnatural-language-processingnatural-language-understandingnlptransformers

Licencia y mantenimiento

Apache-2.0 es una licencia permisiva: uso comercial libre con atribución.

Último cambio de código hoy.

	Repositorio	Estrellas	Lenguaje	Licencia	Actividad
1	microsoft/generative-ai-for-beginners21 Lessons, Get Started Building with Generative AI	★ 121.6k	Jupyter Notebook	MIT	Activo
2	rasbt/LLMs-from-scratchImplement a ChatGPT-like LLM in PyTorch from scratch, step by step	★ 106.8k	Jupyter Notebook	Other	Activo
3	Significant-Gravitas/AutoGPTAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w	★ 187.6k	Python	Other	Activo
4	huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f	★ 167.8k	Python	Apache-2.0	Activo
5	langgenius/difyBuild Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-ho	★ 158.8k	Python	Other	Activo
6	vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs	★ 94.1k	Python	Apache-2.0	Activo
7	OpenHands/OpenHands🙌 OpenHands: AI-Driven Development	★ 91.2k	TypeScript	MIT	Activo
8	dair-ai/Prompt-Engineering-Guide🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.	★ 79.3k	MDX	MIT	Menos activo