Sealbook
Sealbook / Open source / Agentes de IA y apps con LLM

vitoplantamura/OnnxStream

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.

llamamachine-learningmistralonnxraspberry-pistable-diffusiontinymlwasmwebassemblywhisper
GitHub ↗Sitio ↗

Licencia y mantenimiento

Licencia propia o modificada que GitHub no reconoce: lee el archivo LICENSE del repositorio antes de usarlo en un producto.

Último cambio de código hace 4 meses.

Proyectos similares

RepositorioEstrellasLenguajeLicenciaActividad
1ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.★ 183.7kGoMITActivo
2huggingface/transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, f★ 167.8kPythonApache-2.0Activo
3vllm-project/vllmA high-throughput and memory-efficient inference and serving engine for LLMs★ 94.1kPythonApache-2.0Activo
4unslothai/unslothLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.★ 78.2kPythonApache-2.0Activo
5hiyouga/LlamaFactoryUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)★ 75.6kPythonApache-2.0Activo
6ggml-org/whisper.cppPort of OpenAI's Whisper model in C/C++★ 54.5kC++MITActivo
7mudler/LocalAILocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.★ 49.6kGoMITActivo
8paperless-ngx/paperless-ngxA community-supported supercharged document management system: scan, index and archive all your documents★ 46.8kPythonGPL-3.0Activo