GeeeekExplorer/nano-vllm

License & maintenance

MIT is a permissive license: free to use commercially with attribution.

Last code push 5 months ago.

Similar projects

	Repository	Stars	Language	License	Activity
1	SYSTRAN/faster-whisperFaster Whisper transcription with CTranslate2	★ 25.9k	Python	MIT	Active
2	huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f	★ 167.8k	Python	Apache-2.0	Active
3	ggml-org/whisper.cppPort of OpenAI's Whisper model in C/C++	★ 54.5k	C++	MIT	Active
4	ray-project/rayRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.	★ 44.1k	Python	Apache-2.0	Active
5	google/langextractA Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visua	★ 39k	Python	Apache-2.0	Active
6	sgl-project/sglangSGLang is a high-performance serving framework for large language models and multimodal models.	★ 37.3k	Python	Apache-2.0	Active
7	p-e-w/hereticFully automatic censorship removal for language models	★ 35.7k	Python	AGPL-3.0	Active
8	AccumulateMore/CV✅（已完结）超级全面的 深度学习 笔记【土堆 Pytorch】【李沐 动手学深度学习】【吴恩达 深度学习】【大飞 大模型Agent】	★ 24.1k	Jupyter Notebook	—	Active