dqbd/tiktokenizer

License & maintenance

MIT is a permissive license: free to use commercially with attribution.

Last code push 18 months ago.

Similar projects

	Repository	Stars	Language	License	Activity
1	OpenHands/OpenHands🙌 OpenHands: AI-Driven Development	★ 91.2k	TypeScript	MIT	Active
2	dair-ai/Prompt-Engineering-Guide🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.	★ 79.3k	MDX	MIT	Slowing
3	openai/openai-cookbookExamples and guides for using the OpenAI API	★ 76.7k	Jupyter Notebook	MIT	Active
4	elder-plinius/CL4R1T4SLEAKED SYSTEM PROMPTS FOR CHATGPT, CLAUDE, GEMINI, GROK, PERPLEXITY, CURSOR, LOVABLE, REPLIT, AND MORE! - AI SYSTEMS TRANSPARENCY FOR ALL! 👐	★ 51.3k	—	AGPL-3.0	Active
5	LAION-AI/Open-AssistantOpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically	★ 37.4k	Python	Apache-2.0	Stale
6	songquanpeng/one-apiLLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 适配，可用于 key 管理与	★ 37.2k	JavaScript	MIT	Slowing
7	onyx-dot-app/onyxOpen Source AI Platform - AI Chat with advanced features that works with every LLM	★ 32.6k	Python	Other	Active
8	labring/FastGPTFastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing	★ 29.9k	TypeScript	Other	Active