Research in investment finance with Python Notebooks

A pedagogical implementation of Autograd

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.

Robust recipes to align language models with human and AI preferences

Universal and Transferable Attacks on Aligned Language Models

Code for STaR: Bootstrapping Reasoning With Reasoning (NeurIPS 2022)

[ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".

Reference implementation for DPO (Direct Preference Optimization)

Implementation of paper Data Engineering for Scaling Language Models to 128K Context

simple experiments with node perturbation.

[NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333

This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?

Awesome-LLM: a curated list of Large Language Model

Public quant internship repository, maintained by NUFT but available for everyone.

Contains Company Wise Questions sorted based on Frequency and all time

Structured state space sequence models

Implementation of https://srush.github.io/annotated-s4

Mamba SSM architecture

Implementation of the "Online learning of long-range dependencies" paper, NeurIPS 2023

📚 Solutions to Introduction to Algorithms Third Edition

Building blocks for foundation models.