google-ai-edge/LiteRT-LM
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
License & maintenance
Apache-2.0 is a permissive license: free to use commercially with attribution.
Last code push today.