A GKR-based zero-knowledge proof protocol for CNN model inference.

yes

Just playing with getting VQGAN+CLIP running locally, rather than having to use colab.

Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

Official PyTorch implementation of StyleGAN3

Code repository for our paper "Failing Loudly: An Empirical Study of Methods for Detecting Dataset Shift": https://arxiv.org/abs/1810.11953

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

Alias-Free GAN project website and code

Anonymous Github is a proxy server to support anonymous browsing of Github repositories for open-science code and data.

Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference,…

See the issue board for the current status of active and prospective projects!

explore the topology of CLIP's embedding space

Privacy Testing for Deep Learning

A library for programmatically generating equivariant layers through constraint solving

Implementation of E(n)-Equivariant Graph Neural Networks, in Pytorch

To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released

Implementation of E(n)-Transformer, which incorporates attention mechanisms into Welling's E(n)-Equivariant Graph Neural Network

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

A modular framework for neural networks with Euclidean symmetry

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

Implementation of Marge, Pre-training via Paraphrasing, in Pytorch

A repository in preparation for open-sourcing lottery ticket hypothesis code.

A fast covertree implementation

Collection of red machine learning projects

A curated list of awesome network analysis resources.