An Open Source Implementation of Anthropic's Paper: "Towards Monosemanticity: Decomposing Language Models with Dictionary Learning"

LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. *Check out demo at* https://huggingface.co/spaces/facebook/l…

Training Sparse Autoencoders on Language Models

A library for mechanistic interpretability of GPT-style language models

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SFT etc.

中文自然语言处理数据集，平时做做实验的材料。欢迎补充提交合并。

立党零基础转码笔记

我的 ComfyUI 工作流合集 | My ComfyUI workflows collection

[SIGIR'24] The official implementation code of MOELoRA.

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

用于从头预训练+SFT一个小参数量的中文LLaMa2的仓库；24G单卡即可运行得到一个具备简单中文问答能力的chat-llama2.

Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.

This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.

[OneKE] [ACL 2024] IEPile: A Large-Scale Information Extraction Corpus

Materials for the Hugging Face Diffusion Models Course

Let us control diffusion models!

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

Evaluation suite for LLMs

This project studies the performance and robustness of language models and task-adaptation methods.

Modeling, training, eval, and inference code for OLMo

Data and tools for generating and inspecting OLMo pre-training data.

OCR, layout analysis, reading order, line detection in 90+ languages

This repository contains a custom implementation of the BERT model, fine-tuned for specific tasks, along with an implementation of Low Rank Approximation (LoRA). The models are optimized for high p…