tile-ai/TileRT
Tile-Based Runtime for Ultra-Low-Latency LLM Inference
License & maintenance
MIT is a permissive license: free to use commercially with attribution.
Last code push 25 days ago.
Tile-Based Runtime for Ultra-Low-Latency LLM Inference
MIT is a permissive license: free to use commercially with attribution.
Last code push 25 days ago.