#
Lists (3)
Starred repositories
Metrics to evaluate quality and efficacy of synthetic datasets.
An Evaluation of ChatGPT on Information Extraction task, including Named Entity Recognition (NER), Relation Extraction (RE), Event Extraction (EE) and Aspect-based Sentiment Analysis (ABSA).
OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)
Guide for fine-tuning Llama/Mistral/CodeLlama models and more
Let's build better datasets, together!
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
Running large language models on a single GPU for throughput-oriented scenarios.
Use PEFT or Full-parameter to finetune 300+ LLMs or 60+ MLLMs. (Qwen2, GLM4v, Internlm2.5, Yi, Llama3.1, Llava-Video, Internvl2, MiniCPM-V-2.6, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)
LLM based autonomous agent that does online comprehensive research on any given topic
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
PECOS - Prediction for Enormous and Correlated Spaces
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHX…
A Gradio web UI for Large Language Models.
A code repository that cointains all the code for finetuning some of the popular LLMs on medical data
Training LLMs with QLoRA + FSDP
Vector Database with support for late interaction and token level embeddings.
🦉 Modern high-performance serialization utilities for Python (JSON, MessagePack, Pickle)
A scalable, distributed, collaborative, document-graph database, for the realtime web
A native PyTorch Library for large model training