Skip to content
/ Fine-tuning-Mistral-7b-QA Public

Fine tuning Mistral-7b with PEFT(Parameter Efficient Fine-Tuning) and LoRA(Low-Rank Adaptation) on Puffin Dataset(multi-turn conversations between GPT-4 and real humans)

10 stars 0 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

alinourian/Fine-tuning-Mistral-7b-QA

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
README.md
README.md
 
 
mistral-7b-inference.ipynb
mistral-7b-inference.ipynb
 
 
mistral_7b_fine_tuning_with_peft_lora_and_wandb.ipynb
mistral_7b_fine_tuning_with_peft_lora_and_wandb.ipynb
 
 

Repository files navigation

Fine-tuning-Mistral-7b-QA

Fine tuning Mistral-7b with PEFT(Parameter Efficient Fine-Tuning) and LoRA(Low-Rank Adaptation) on Puffin Dataset(multi-turn conversations between GPT-4 and real humans) with wandb

About

Fine tuning Mistral-7b with PEFT(Parameter Efficient Fine-Tuning) and LoRA(Low-Rank Adaptation) on Puffin Dataset(multi-turn conversations between GPT-4 and real humans)

Topics

lora fine-tuning peft puffin multi-turn-dialogue wandb hugging-face gpt-4 large-language-models llm low-rank-adaptation parameter-efficient-fine-tuning mistral-7b

Resources

Readme
Activity

Stars

10 stars

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages