Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

本项目将《动手学深度学习》(Dive into Deep Learning)原书中的MXNet实现改为PyTorch实现。

FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.

llama3 implementation one matrix multiplication at a time

面向开发者的 LLM 入门教程，吴恩达大模型系列课程中文版

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supportin…

LAVIS - A One-stop Library for Language-Vision Intelligence

《开源大模型食用指南》基于Linux环境快速部署开源大模型，更适合中国宝宝的部署教程

PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation

本项目是一个面向小白开发者的大模型应用开发教程，在线阅读地址：https://datawhalechina.github.io/llm-universe/

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts…

The hub for EleutherAI's work on interpretability and learning dynamics

温州大学《机器学习》课程资料（代码、课件等）

A comprehensive guide to building RAG-based LLM applications for production.

仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理

Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.