Collection of awesome parameter-efficient fine-tuning resources.
-
Updated
Jul 11, 2024
Collection of awesome parameter-efficient fine-tuning resources.
The Paper List of Large Multi-Modality Model, Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insight.
[ECCV2024] The code of "SHERL: Synthesizing High Accuracy and Efficient Memory for Resource-Limited Transfer Learning"
[ECCV 2024] - Improving Zero-shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation
A generalized framework for subspace tuning methods in parameter efficient fine-tuning.
This repository contain a project which goal is to find new parameter efficient fine tuning framework in order to improve performance of Deep Artificial Neural Network onto "out of distribution" data (OOD). In this specific case you can find Multi-task Learning problem.
[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation
Fine-Tuned LLM-Based FAQ Generation for University Admissions: A project involving the fine-tuning of state-of-the-art language models, including LLaMA-3 8b, LLaMA-2 7b, Mistral 7b, T5, and BART, leveraging QLoRA PEFT.
CorDA: Context-Oriented Decomposition Adaptation of Large Language Models
This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of Adapters".
[SIGIR'24] The official implementation code of MOELoRA.
[WACV 2024] MACP: Efficient Model Adaptation for Cooperative Perception.
[CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"
Code for the EACL 2024 paper: "Small Language Models Improve Giants by Rewriting Their Outputs"
[ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
A framework to optimize Parameter-Efficient Fine-Tuning for Fairness in Medical Image Analysis
[ICRA 2024] Official Implementation of the Paper "Parameter-efficient Prompt Learning for 3D Point Cloud Understanding"
A Production-Ready, Scalable RAG-powered LLM-based Context-Aware QA App
Exploring the potential of fine-tuning Large Language Models (LLMs) like Llama2 and StableLM for medical entity extraction. This project focuses on adapting these models using PEFT, Adapter V2, and LoRA techniques to efficiently and accurately extract drug names and adverse side-effects from pharmaceutical texts
This repository contains the lab work for Coursera course on "Generative AI with Large Language Models".
Add a description, image, and links to the parameter-efficient-fine-tuning topic page so that developers can more easily learn about it.
To associate your repository with the parameter-efficient-fine-tuning topic, visit your repo's landing page and select "manage topics."