Skip to content
View ranpin's full-sized avatar

Block or report ranpin

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
4 stars written in Cuda
Clear filter

how to optimize some algorithm in cuda.

Cuda 1,471 122 Updated Sep 29, 2024

🎉 Modern CUDA Learn Notes with PyTorch: fp32, fp16, bf16, fp8/int8, flash_attn, sgemm, sgemv, warp/block reduce, dot, elementwise, softmax, layernorm, rmsnorm.

Cuda 1,196 128 Updated Sep 29, 2024

Flash Attention in ~100 lines of CUDA (forward pass only)

Cuda 566 50 Updated Apr 7, 2024