Sealbook / Open source / Web & backend frameworks

weicj/vLLM-2080Ti-Definitive

The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-request decode with support of FP8 weight ( Join Discord :https://discord.gg/VFqVVySdMS )

GitHub ↗

License & maintenance

Apache-2.0 is a permissive license: free to use commercially with attribution.

Last code push 18 days ago.

Similar projects

	Repository	Stars	Language	License	Activity
1	public-apis/public-apisA collective list of free APIs	★ 490k	Python	MIT	Active
2	obra/superpowersAn agentic skills framework & software development methodology that works.	★ 301.6k	Shell	MIT	Active
3	vuejs/vueThis is the repo for Vue 2. For Vue 3, go to https://github.com/vuejs/core	★ 212.6k	TypeScript	MIT	Stale
4	flutter/flutterFlutter makes it easy and fast to build beautiful apps for mobile and beyond	★ 180.3k	Dart	BSD-3-Clause	Active
5	vercel/next.jsThe React Framework	★ 143.1k	JavaScript	MIT	Active
6	shadcn-ui/uiComposable, accessible components with thoughtful defaults. Build your own component library with code you can customize, extend, and make y	★ 125.9k	TypeScript	MIT	Active
7	electron/electron:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS	★ 123.4k	C++	MIT	Active
8	nodejs/nodeNode.js JavaScript runtime ✨🐢🚀✨	★ 122.4k	JavaScript	Other	Active