[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction

Fine-Tune LLM Synthetic-Data application and "From Data to AGI: Unlocking the Secrets of Large Language Model"

Official code repo for the paper "LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Dataset"

[ACL 2024] An Easy-to-use Instruction Processing Framework for LLMs.

[ICLR 2024] Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Models

An open-source project dedicated to build foundational large language model for natural science, mainly in physics, chemistry and material science.

Web-Scarping tool for downloading the content of the following publishers: Elsevier, RSC, Web of Science, Springer Nature , Wiley.

Large Language Model Text Generation Inference

Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigscience/license) using Alpaca-LoRA and Alpaca_data_cleaned.json

Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

Finetuning a small BLOOMZ model (bloomz-560m) on a small dataset and with limited resources.

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

TianGong-AI-Unstructure

NLTK Data

An Open-sourced Knowledgable Large Language Model Framework.

Code for the paper "Language Models are Unsupervised Multitask Learners"

LLM training in simple, raw C/CUDA

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

The official implementation of MarineGPT

An application allowing for interaction with different LLM models. With the option to provide PDF, web and CSV links for context.

Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"

The papers are organized according to our survey: Evaluating Large Language Models: A Comprehensive Survey.

The official GitHub page for the survey paper "A Survey of Large Language Models".

This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.

A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

Codes and packages for the paper titled Evaluating Retrieval Quality in Retrieval-Augmented Generation.

Measuring Massive Multitask Language Understanding | ICLR 2021

Continual Learning of Large Language Models: A Comprehensive Survey