triton-inference-server/server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

clouddatacenterdeep-learningedgegpuinferencemachine-learning

License & maintenance

BSD-3-Clause is a permissive license: free to use commercially with attribution.

Last code push 2 days ago.

	Repository	Stars	Language	License	Activity
1	deepspeedai/DeepSpeedDeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.	★ 43.2k	Python	Apache-2.0	Active
2	pytorch/pytorchTensors and Dynamic neural networks in Python with strong GPU acceleration	★ 104.8k	Python	Other	Active
3	fastai/fastaiThe fastai deep learning library	★ 28.2k	Jupyter Notebook	Apache-2.0	Active
4	apache/tvmOpen Machine Learning Compiler Framework	★ 13.8k	Python	Apache-2.0	Active
5	aws/amazon-sagemaker-examplesExample 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.	★ 11k	Jupyter Notebook	Apache-2.0	Active
6	tensorflow/tensorflowAn Open Source Machine Learning Framework for Everyone	★ 201.1k	C++	Apache-2.0	Active
7	d2l-ai/d2l-zh《动手学深度学习》：面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。	★ 81.9k	Python	Apache-2.0	Stale
8	microsoft/AI-For-Beginners12 Weeks, 24 Lessons, AI for All!	★ 69.9k	Jupyter Notebook	MIT	Active