LLM inference in C/C++

C++那些事

OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

A library for efficient similarity search and clustering of dense vectors.

Collection of various algorithms in mathematics, machine learning, computer science and physics implemented in C++ for educational purposes.

LeetCode Problems' Solutions

Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research

WebRTC/RTSP/RTMP/HTTP/HLS/HTTP-FLV/WebSocket-FLV/HTTP-TS/HTTP-fMP4/WebSocket-TS/WebSocket-fMP4/GB28181/SRT server and client framework based on C++11

C++ Parallel Computing and Asynchronous Networking Framework

An open source library for face detection in images. The face detection speed can reach 1000FPS.

超轻量级中文ocr，支持竖排文字识别, 支持ncnn、mnn、tnn推理 ( dbnet(1.8M) + crnn(2.5M) + anglenet(378KB)) 总模型仅4.7M

Turi Create simplifies the development of custom machine learning models.

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

Stellarium is a free GPL software which renders realistic skies in real time with OpenGL. It is available for Linux/Unix, Windows and macOS. With Stellarium, you really see what you can see with yo…

Cartographer is a system that provides real-time simultaneous localization and mapping (SLAM) in 2D and 3D across multiple platforms and sensor configurations.

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

Transformer related optimization, including BERT, GPT

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

CUDA Templates for Linear Algebra Subroutines

Caffe: a fast open framework for deep learning.

Tengine is a lite, high performance, modular inference engine for embedded device

MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.

高性能并行编程与优化 - 课件

纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行

C++ library based on tensorrt integration

（已长久停更）

《C++ Templates 第二版》中文翻译，和原书排版一致，第一部分（1至11章）以及第18，19，20，21、22、23、24、25章已完成，其余内容逐步更新中。 个人爱好，发现错误请指正

TengineKit - Free, Fast, Easy, Real-Time Face Detection & Face Landmarks & Face Attributes & Hand Detection & Hand Landmarks & Body Detection & Body Landmarks & Iris Landmarks & Yolov5 SDK On Mobile.

The minimal opencv for Android, iOS, ARM Linux, Windows, Linux, MacOS, WebAssembly

🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~