My personal webpage

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Bayesian IRT models in Python

Evaluating LLMs with fewer examples

Code for 'Emergent Analogical Reasoning in Large Language Models'

Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.

Code for the paper: "Simulation-Based Inference with Generative Neural Networks via Scoring Rule Minimization"

The papers are organized according to our survey: Evaluating Large Language Models: A Comprehensive Survey.

Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110).

A free React / Next.js landing page template designed to showcase open source projects, SaaS products, online services, and more. Made by

Finetuning LLaMA with DeepSpeed

ABCpy package

Conformal Bayes with importance sampling

Python framework for short-term ensemble prediction systems.

Simulation-based inference benchmark

Testing methods for estimating KL-divergence from samples.

Gemini is a modern LaTex beamerposter theme 🖼

MINE: Mutual Information Neural Estimation in pytorch

recommendation system with python