rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

aiartificial-intelligenceattention-mechanismdeep-learningfinetuningfrom-scratchgenerative-aigptinstruction-tuninglanguage-model

License & maintenance

Custom or modified license that GitHub does not recognise: read the LICENSE file in the repository before using it in a product.

Last code push 16 days ago.

	Repository	Stars	Language	License	Activity
1	microsoft/generative-ai-for-beginners21 Lessons, Get Started Building with Generative AI	★ 121.6k	Jupyter Notebook	MIT	Active
2	Significant-Gravitas/AutoGPTAutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on w	★ 187.6k	Python	Other	Active
3	dair-ai/Prompt-Engineering-Guide🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.	★ 79.3k	MDX	MIT	Slowing
4	hiyouga/LlamaFactoryUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)	★ 75.6k	Python	Apache-2.0	Active
5	vercel/aiThe AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications a	★ 27.4k	TypeScript	Other	Active
6	huggingface/datasets🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools	★ 22.1k	Python	Apache-2.0	Active
7	langgenius/difyBuild Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-ho	★ 158.8k	Python	Other	Active
8	langchain-ai/langchainThe agent engineering platform.	★ 148k	Python	MIT	Active