Sealbook

huawei-noah/Pretrained-Language-Model

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

knowledge-distillationlarge-scale-distributedmodel-compressionpretrained-modelsquantization

License & maintenance

No license stated: by default nobody may reuse the code. Ask the authors before using it in a product.

Last code push 2 years ago.