🎉CUDA/C++ 笔记 / 技术博客: fp32、fp16/bf16、fp8/int8、flash_attn、sgemm、sgemv、warp/block reduce、dot prod、elementwise、softmax、layernorm、rmsnorm、hist etc.

FlashInfer: Kernel Library for LLM Serving

Not All Pixels Are Equal: Difficulty-Aware Semantic Segmentation via Deep Layer Cascade