[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Unbearably fast near-real-time hybrid runtime-static type-checking in pure Python.

Code for the paper 🌳 Tree Search for Language Model Agents

Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI

LLM inference in C/C++

The Mojo Programming Language

The official PyTorch implementation of Google's Gemma models

An interactive structure/property explorer for materials and molecules

FAIR Chemistry's library of machine learning methods for chemistry

📝 Today I Learned

Inference code for Llama models

Workflow for creating and analyzing the Open Catalyst Dataset

[ICLR 2024] EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representations

A book on modeling materials using VASP, ase and vasp

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

Code for training embodied agents using IL and RL finetuning at scale for ObjectNav

Differentiable scientific computing library

Differentiable Quantum Chemistry (only Differentiable Density Functional Theory and Hartree Fock at the moment)

Tensors, for human consumption

Open MatSci ML Toolkit is a framework for prototyping and scaling out deep learning models for materials discovery supporting widely used materials science datasets, and built on top of PyTorch Lig…

jax library for E3 Equivariant Neural Networks

Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy

The Fast Cross-Platform Package Manager

Code for training embodied agents using imitation learning at scale in Habitat-Lab

Graphormer is a general-purpose deep learning backbone for molecular modeling.

A modular framework for neural networks with Euclidean symmetry

Code for the paper "Planning with Diffusion for Flexible Behavior Synthesis"

🌊 A Human-in-the-Loop workflow for creating HD images from text

Habitat-Web is a web application to collect human demonstrations for embodied tasks on Amazon Mechanical Turk (AMT) using the Habitat simulator.