SSealbook

davidmrau/mixture-of-experts

PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538

mixture-of-expertsmoepytorchre-implementationsparsely-gated-mixture-of-experts

License & maintenance

GPL-3.0 is a copyleft license: products that include or modify it may have to publish their code.

Last code push 2 years ago.