Tencent/TurboTransformers

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

albertbertdecodergpt2gpuhuggingface-transformersinferencemachine-translationnlppytorch

License & maintenance

Custom or modified license that GitHub does not recognise: read the LICENSE file in the repository before using it in a product.

Last code push 15 months ago.

	Repository	Stars	Language	License	Activity
1	deepspeedai/DeepSpeedDeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.	★ 43.2k	Python	Apache-2.0	Active
2	NandhaKishorM/layaNon-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ langua	★ 33.4k	Python	Apache-2.0	Active
3	fastai/fastaiThe fastai deep learning library	★ 28.2k	Jupyter Notebook	Apache-2.0	Active
4	flairNLP/flairA very simple framework for state-of-the-art Natural Language Processing (NLP)	★ 14.4k	Python	Other	Slowing
5	allenai/allennlpAn open-source NLP research library, built on PyTorch.	★ 11.9k	Python	Apache-2.0	Archived
6	NielsRogge/Transformers-TutorialsThis repository contains demos I made with the Transformers library by HuggingFace.	★ 11.8k	Jupyter Notebook	MIT	Active
7	triton-inference-server/serverThe Triton Inference Server provides an optimized cloud and edge inferencing solution.	★ 11.1k	Python	BSD-3-Clause	Active
8	AUTOMATIC1111/stable-diffusion-webuiStable Diffusion web UI	★ 165.1k	Python	AGPL-3.0	Slowing