bigscience-workshop/Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
License & maintenance
Custom or modified license that GitHub does not recognise: read the LICENSE file in the repository before using it in a product.
Last code push 2 years ago.