Sealbook / Open source / AI agents & LLM apps

Liuhong99/Sophia

The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”

deep-learninglarge-language-modelsoptimizer

License & maintenance

MIT is a permissive license: free to use commercially with attribution.

Last code push 2 years ago.

Similar projects

	Repository	Stars	Language	License	Activity
1	ray-project/rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.	★ 44.1k	Python	Apache-2.0	Active
2	stefan-jansen/machine-learning-for-tradingCode for Machine Learning for Trading, 3rd edition — from data sourcing to live execution.	★ 21.4k	Jupyter Notebook	MIT	Active
3	huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f	★ 167.8k	Python	Apache-2.0	Active
4	langflow-ai/langflowLangflow is a powerful tool for building and deploying AI-powered agents and workflows.	★ 155.8k	Python	MIT	Active
5	rasbt/LLMs-from-scratchImplement a ChatGPT-like LLM in PyTorch from scratch, step by step	★ 106.8k	Jupyter Notebook	Other	Active
6	dair-ai/Prompt-Engineering-Guide🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.	★ 79.3k	MDX	MIT	Slowing
7	hiyouga/LlamaFactoryUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)	★ 75.6k	Python	Apache-2.0	Active
8	binary-husky/gpt_academic为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入	★ 71.5k	Python	GPL-3.0	Slowing