SSealbook

ai-dynamo/dynamo

A Datacenter Scale Distributed Inference Serving Framework

diffusiondisaggregated-servingkubernetesllm-inferenceomnirouting-enginerustsglangtensorrt-llmvllm

License & maintenance

Custom or modified license that GitHub does not recognise: read the LICENSE file in the repository before using it in a product.

Last code push today.