Open weights LLM from Google DeepMind.

SimPO: Simple Preference Optimization with a Reference-Free Reward

An Extensible Deep Learning Library

A Gossip protocol that using UDP with ebpf feature

A collection of AWESOME things about mixture-of-experts

A curated reading list of research in Mixture-of-Experts(MoE).

Neural Networks and the Chomsky Hierarchy

A VA-API implemention using NVIDIA's NVDEC

LLM training in simple, raw C/CUDA

This is the code repository associated with the paper "Abstractors and relational cross-attention: An inductive bias for explicit relational reasoning in Transformers"

LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. *Check out demo at* https://huggingface.co/spaces/facebook/l…

The official Meta Llama 3 GitHub site

Rodinia benchmark

Annotated version of the Mamba paper

Firefox user.js for speed, privacy, and security. Your favorite browser, but better.

Sioyek is a PDF viewer with a focus on textbooks and research papers

constrained nonlinear optimization for scientific machine learning, UQ, and AI

Local support for Tuya devices in Home Assistant

Use any linux distribution inside your terminal. Enable both backward and forward compatibility with software and freedom to use whatever distribution you’re more comfortable with. Mirror available…

CUDA related news and material links

Network Analysis in Python

Code for "Heterogenity-Aware Cluster Scheduling Policies for Deep Learning Workloads", which appeared at OSDI 2020

A Vim-like interface for Firefox, inspired by Vimperator/Pentadactyl.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Minimalist ML framework for Rust

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.