Stars
Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.
Universal LLM Deployment Engine with ML Compilation
Practical GPU Sharing Without Memory Size Constraints
A machine learning compiler for GPUs, CPUs, and ML accelerators
Intel staging area for llvm.org contribution. Home for Intel LLVM-based projects.
Transformer related optimization, including BERT, GPT
🐶 Kubernetes CLI To Manage Your Clusters In Style!
A Cloud Native Batch System (Project under CNCF)
MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.
PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎）
Squeezenet V1.1 on Cyclone V SoC-FPGA at 450ms/image, 20x faster than ARM A9 processor alone. A project for 2017 Innovate FPGA design contest.
Bolt is a deep learning library with high performance and heterogeneous flexibility.
Code for our CVPR 2019 paper: Selective Kernel Networks; See zhihu：https://zhuanlan.zhihu.com/p/59690223
State-of-the-art 2D and 3D Face Analysis Project
MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba
Tengine is a lite, high performance, modular inference engine for embedded device
MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.
FAIR's research platform for object detection research, implementing popular algorithms like Mask R-CNN and RetinaNet.
Arm NN ML Software. The code here is a read-only mirror of https://review.mlplatform.org/admin/repos/ml/armnn
Quantized Neural Network PACKage - mobile-optimized implementation of quantized neural network operators
Caffe for Sparse and Low-rank Deep Neural Networks
Intel® Nervana™ reference deep learning framework committed to best performance on all hardware