-
TinyChatEngine Public
Forked from mit-han-lab/TinyChatEngineTinyChatEngine: On-Device LLM Inference Library
C++ MIT License UpdatedJul 22, 2024 -
llama.cpp Public
Forked from ggerganov/llama.cppLLM inference in C/C++
C++ MIT License UpdatedJul 22, 2024 -
TensorRT-LLM Public
Forked from NVIDIA/TensorRT-LLMTensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…
C++ Apache License 2.0 UpdatedMay 30, 2024 -
Awesome-LLM-Inference Public
Forked from DefTruth/Awesome-LLM-Inference📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
GNU General Public License v3.0 UpdatedFeb 25, 2024 -
annotated-transformer Public
Forked from harvardnlp/annotated-transformerAn annotated implementation of the Transformer paper.
Jupyter Notebook MIT License UpdatedJan 29, 2024 -
transformer Public
Forked from hyunwoongko/transformerTransformer: PyTorch Implementation of "Attention Is All You Need"
Python UpdatedJan 24, 2024 -
-
Install-OpenCV-Jetson-Orin Public
Forked from Qengineering/Install-OpenCV-Jetson-NanoOpenCV installation script with CUDA and cuDNN support
-
Tengine Public
Forked from OAID/TengineTengine is a lite, high performance, modular inference engine for embedded device
C++ Apache License 2.0 UpdatedApr 18, 2023 -
-
awesome-cpp Public
Forked from fffaraz/awesome-cppA curated list of awesome C++ (or C) frameworks, libraries, resources, and shiny things. Inspired by awesome-... stuff.
MIT License UpdatedMar 23, 2023 -
taskflow Public
Forked from taskflow/taskflowA General-purpose Parallel and Heterogeneous Task Programming System
C++ Other UpdatedMar 6, 2023 -
awesome-c Public
Forked from oz123/awesome-cA curated list of awesome C frameworks, libraries, resources and other shiny things. Inspired by all the other awesome-... projects out there.
Creative Commons Attribution Share Alike 4.0 International UpdatedFeb 19, 2023 -
threadpool-1 Public
Forked from lzpong/threadpoolbased on C++11 , a mini threadpool , accept variable number of parameters 基于C++11的线程池,简洁且可以带任意多的参数
C++ UpdatedFeb 15, 2023 -
ThreadPool Public
Forked from progschj/ThreadPoolA simple C++11 Thread Pool implementation
C++ zlib License UpdatedDec 20, 2022 -
-
PINTO_model_zoo Public
Forked from PINTO0309/PINTO_model_zooA repository that shares tuning results of trained models generated by TensorFlow / Keras. Post-training quantization (Weight Quantization, Integer Quantization, Full Integer Quantization, Float16 …
Python MIT License UpdatedOct 18, 2022 -
NetAssist_PyQt Public
Forked from muziing/NetAssist_PyQt一个用PyQt5实现的网络调试助手工具。TCP UDP WebServer三种模式
Python MIT License UpdatedAug 30, 2022 -
-
deepstream-6.1 Public
resource comes from deepstream-6.1_6.1.0-1_amd64.deb
-
-
gst-MyProject Public
gstreamer plugin study based on 1.16, code from gst-plugins-bad template
C Other UpdatedMay 16, 2022 -
GObjectTutorial Public
Forked from sgros/GObjectTutorialExample code on how to use GObject in C programming language
C GNU General Public License v2.0 UpdatedMay 15, 2022 -
gst-project-template Public
This is gstreamer project template which including plugin and app
C Other UpdatedMay 2, 2022 -
gst-plugins-bad Public
Forked from GStreamer/gst-plugins-bad'Bad' GStreamer plugins and helper libraries. This module has been merged into the main GStreamer repo for further development.
C GNU Lesser General Public License v2.1 UpdatedFeb 23, 2022 -
-
ArmnnBackendFramework Public
This is the Framework used for developing ArmNN backend. It can compiled without error under armnn_21_05
-
armnn Public
Forked from ARM-software/armnnArm NN ML Software. The code here is a read-only mirror of https://review.mlplatform.org/admin/repos/ml/armnn
C++ MIT License UpdatedSep 16, 2021 -
-
Paddle-Lite Public
Forked from PaddlePaddle/Paddle-LiteMulti-platform high performance deep learning inference engine (『飞桨』多平台高性能深度学习预测引擎)
C++ Apache License 2.0 UpdatedJul 25, 2021