Sealbook / Open source / Machine learning & data science

NVIDIA/TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

deep-learninggpu-accelerationinferencenvidiatensorrt

GitHub ↗Website ↗

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 9 days ago.

Similar projects

	Repository	Stars	Language	License	Activity
1	ultralytics/yolov5Ultralytics YOLOv5 in PyTorch for object detection, instance segmentation, classification, training, and export.	★ 58.2k	Python	AGPL-3.0	Active
2	deepspeedai/DeepSpeedDeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.	★ 43.2k	Python	Apache-2.0	Active
3	hpcaitech/ColossalAIMaking large AI models cheaper, faster and more accessible	★ 41.4k	Python	Apache-2.0	Active
4	google-ai-edge/mediapipeCross-platform, customizable ML solutions for live and streaming media.	★ 37.3k	C++	Apache-2.0	Active
5	Tencent/ncnnncnn is a high-performance neural network inference framework optimized for the mobile platform	★ 24k	C++	Other	Active
6	tensorflow/tfjsA WebGL accelerated JavaScript library for training and deploying ML models.	★ 19.1k	TypeScript	Apache-2.0	Slowing
7	triton-inference-server/serverThe Triton Inference Server provides an optimized cloud and edge inferencing solution.	★ 11.1k	Python	BSD-3-Clause	Active
8	openvinotoolkit/openvinoOpenVINO™ is an open source toolkit for optimizing and deploying AI inference	★ 11k	C++	Apache-2.0	Active