onnx-runtime

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.

Android 17 local LLM prototype with Jetpack Compose and ONNX Runtime for offline AI inference experiments.

YoloDotNet - A C# .NET 8.0 project for Classification, Object Detection, OBB Detection, Segmentation and Pose Estimation in both images and live video streams.

🚀 A high performance real-time object detection solution using YOLO11 ⚡️ powered by ONNX-Runtime

Cross-platform on-device AI toolkit

Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.

Full face stack that runs entirely in the browser. Detection, 576-point 3D mesh, recognition, anti-spoof, smile — all WebAssembly, zero server. Apache 2.0.

Rust wrapper for Microsoft's ONNX Runtime (version 1.8)

Edge Inference in Browser with Transformer NLP model

Face recognition and analytics library based on deep neural networks and ONNX runtime

The Next-Gen Database for AI—an infrastructure designed for data and AI. As the MySQL of the AI era.

The Triton backend for the ONNX Runtime.

Speaker diarization in Rust with pyannote-level accuracy. 1790–5970x realtime on NVIDIA GPUs, 430–910x on Apple Silicon.

On-device speech SDK for Android — ASR, TTS, VAD, and noise cancellation powered by ONNX Runtime with Qualcomm NNAPI acceleration

Distribute and run transformer encoders with a single file.

Offline video material retrieval platform for semantic search, subtitle search, Agent API, and AI-assisted editing.

A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.

EdgeLite: 开源边缘AI网关，13种工业协议+ONNX推理引擎，传感器/视觉AI双确认。Python，10分钟Docker部署。