#

int4

Here are 2 public repositories matching this topic...

tpoisonooo / how-to-optimize-gemm

row-major matmul optimization

vulkan cuda armv7 arm64 ptx gemm-optimization cuda-kernel int4

Updated Sep 9, 2023
C++

intel / neural-speed

An innovative library for efficient LLM inference via low-bit quantization

Updated Aug 30, 2024
C++

Improve this page

Add a description, image, and links to the int4 topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the int4 topic, visit your repo's landing page and select "manage topics."