General technology for enabling AI capabilities w/ LLMs and MLLMs

YaFSDP: Yet another Fully Sharded Data Parallel

A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery

Material for cuda-mode lectures

Generative AI on AWS

Video+code lecture on building nanoGPT from scratch

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilizatio…

《跟我一起深度学习》

KAN for Vision Transformer

llama3 implementation one matrix multiplication at a time

Python 数据科学加速：Dask、Ray、Xorbits、mpi4py

Kolmogorov Arnold Networks

AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

Materials for the course: AI ML & Analytics

Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Official implementation for "iTransformer: Inverted Transformers Are Effective for Time Series Forecasting" (ICLR 2024 Spotlight), https://openreview.net/forum?id=JePfAI8fah

Reference implementation of Megalodon 7B model

[Mamba-Survey-2024] Paper list for State-Space-Model/Mamba and it's Applications

基于《cuda编程-基础与实践》（樊哲勇 著）的cuda学习之路。

Learn CUDA Programming, published by Packt

《大语言模型》作者：赵鑫，李军毅，周昆，唐天一，文继荣

This repository contains my homework for CS294-158 course presented in UC Berkeley

Artificial Intelligence Principles and Techniques at Stanford 2023

本项目旨在分享大模型相关技术原理以及实战经验。

Hands-On Graph Neural Networks Using Python, published by Packt