SSealbook
Sealbook / Open source / Machine learning & data science

gordicaleksa/pytorch-original-transformer

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

attentionattention-is-all-you-needattention-mechanismdeep-learningdeeplearningjupyteroriginal-transformerpythonpytorchpytorch-transformer
GitHub ↗Website ↗

License & maintenance

MIT is a permissive license: free to use commercially with attribution.

Last code push 5 years ago.

Similar projects

RepositoryStarsLanguageLicenseActivity
1Jack-Cherish/PythonParkPython 开源项目之「自学编程之路」，保姆级教程：AI实验室、宝藏视频、数据结构、学习指南、机器学习实战、深度学习实战、网络爬虫、大厂面经、程序人生、资源分享。★ 11.9kPython—Stale
2labmlai/annotated_deep_learning_paper_implementations🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback,★ 67.6kPythonMITSlowing
3keras-team/kerasDeep Learning for humans★ 64.4kPythonApache-2.0Active
4ultralytics/ultralyticsUltralytics YOLO27, YOLO26, YOLO11, YOLOv8 — object detection, instance segmentation, semantic segmentation, image classification, pose esti★ 62.6kPythonAGPL-3.0Active
5CorentinJ/Real-Time-Voice-CloningClone a voice in 5 seconds to generate arbitrary speech in real-time★ 60.2kPythonOtherSlowing
6coqui-ai/TTS🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production★ 46.1kPythonMPL-2.0Stale
7OpenBMB/VoxCPMVoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning★ 39.5kPythonApache-2.0Active
8Lightning-AI/pytorch-lightningPretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.★ 31.4kPythonApache-2.0Active