-
Tsinghua University
- https://www.zhihu.com/people/mu-zi-zhi-6-28
- https://bruce-lee-ly.medium.com
-
decoding_attention Public
Decoding Attention is specially optimized for multi head attention (MHA) using CUDA core for the decoding stage of LLM inference.
-
flash_attention_inference Public
Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
-
cuda_hgemv Public
Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.
-
cuda_hook Public
Hooked CUDA-related dynamic libraries by using automated code generation tools.
-
cuda_hgemm Public
Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.
-
cuda_back2back_hgemm Public
Use tensor core to calculate back-to-back HGEMM (half-precision general matrix multiplication) with MMA PTX instruction.
-
matrix_multiply Public
Several common methods of matrix multiplication are implemented on CPU and Nvidia GPU using C++11 and CUDA.
-
algorithm_design Public
Use several algorithm design methods to solve several common problems with C++11.
-
data_structure Public
Several commonly used data structures are implemented with C++11.
C++ MIT License UpdatedJun 2, 2022 -
memory_pool Public
Simple and efficient memory pool is implemented with C++11.
-
deep_learning Public
Implemented the training and inference of several common deep learning model algorithms with tensorflow and pytorch.
-
machine_learning Public
Implement several common machine learning algorithms with sklearn.
Python MIT License UpdatedJun 2, 2022 -
thread_pool Public
Thread pool is implemented to process task queue with C++11.
-
crawler Public
Several fun crawler cases implemented in Python.
Python MIT License UpdatedMay 25, 2022