ncnn is a high-performance neural network inference framework optimized for the mobile platform

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Tengine is a lite, high performance, modular inference engine for embedded device

Simplify your onnx model

🛠 A lite C++ toolkit of awesome AI models, support ONNXRuntime, MNN. Contains YOLOv5, YOLOv6, YOLOX, YOLOR, FaceDet, HeadSeg, HeadPose, Matting etc. Engine: ONNXRuntime, MNN.

ONNX-TensorRT: TensorRT backend for ONNX

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.

Lightweight inference library for ONNX files, written in C++. It can run SDXL on a RPI Zero 2 but also Mistral 7B on desktops and servers.

Speech-to-text, text-to-speech, and speaker recongition using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, Raspberry Pi, RISC-V, x86_64 servers, websocket server/client, C/C++, Python, Kotlin, C#, Go, NodeJS, Java, Swift, Dart, JavaScript

nGraph has moved to OpenVINO

A primitive library for neural network

YOLOv8 using TensorRT accelerate !

Machine learning on FPGAs using HLS

Samples and Tools for Windows ML.

Stable Diffusion in NCNN with c++, supported txt2img and img2img

Bolt is a deep learning library with high performance and heterogeneous flexibility.

Machine learning framework for both deep learning and traditional algorithms

Deploy your model with TensorRT quickly.

Actively maintained ONNX Optimizer