LLM inference in C/C++

MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba

A fast and flexible implementation of Rigid Body Dynamics algorithms and their analytical derivatives

Fast Multimodal LLM on Mobile Devices

Cache design for CNN on mobile

Multi-DNN Inference Engine for Heterogeneous Mobile Processors