AlphaFold 3 inference pipeline.

DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads

Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.

Janus-Series: Unified Multimodal Understanding and Generation Models

Official Pytorch Implementation of Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think

NeuMeta transforms neural networks by allowing a single model to adapt on the fly to different sizes, generating the right weights when needed.

HART: Efficient Visual Generation with Hybrid Autoregressive Transformer

PeRFlow: Piecewise Rectified Flow as Universal Plug-and-Play Accelerator (NeurIPS 2024)

academic personal homepage

Poison-splat: Computation Cost Attack on 3D Gaussian Splatting

A general fine-tuning kit geared toward diffusion models.

This is a repo to track the latest autoregressive visual generation papers.

Official PyTorch Implementation of "Scalable Autoregressive Image Generation with Mamba"

OmniGen: Unified Image Generation. https://arxiv.org/pdf/2409.11340

TPI-LLM: Serving 70b-scale LLMs Efficiently on Low-resource Edge Devices

[NeurIPS 2024 Oral🔥] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs.

VPTQ, A Flexible and Extreme low-bit quantization algorithm

Official PyTorch Implementation of "FlowTurbo: Towards Real-time Flow-Based Image Generation with Velocity Refiner"

Next-Token Prediction is All You Need

Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'

A curated list of resources for using LLMs to develop more competitive grant applications.

[ECCV2024] Vista3D: Unravel the 3D Darkside of a Single Image

Kolmogorov-Arnold Transformer: A PyTorch Implementation with CUDA kernel

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

[ECCV2024] FlashSplat: 2D to 3D Gaussian Splatting Segmentation Solved Optimally

Official implementation of "IFAdapter: Instance Feature Control for Grounded Text-to-Image Generation".