Discussions

• 1 You must be logged in to vote

  🙏

  peft on vision-text transformer (GIT model) does not learn! task type not supported?

  zum8st8 asked Jul 25, 2024 in Q&A · Unanswered

  

  

  6
• 1 You must be logged in to vote

  🙏

  Right way to load Lora checkpoint to further training

  BigDataMLexplorer asked Jul 29, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Load Phi 3 small on Nvidia Tesla V100 - Flash Attention

  BigDataMLexplorer asked Jul 25, 2024 in Q&A · Closed · Unanswered

  

  

  5
• 1 You must be logged in to vote

  🙏

  How to use peft for LoRA ensemble

  DongxiaW asked Jul 23, 2024 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Multiple P-token locations and anchor tokens

  dsosnoski asked Jul 18, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to set_adapter in the forward function?

  Weibin44 asked Jul 12, 2024 in Q&A · Unanswered

  

  

  9
• 3 You must be logged in to vote

  💬

  How to train multiple LoRA adapters on the same base model concurrently.

  rajat95 started Jan 1, 2024 in General

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  Fine tuning for translations in multiple languages

  Grandnainconnu asked Jul 5, 2024 in Q&A · Unanswered

  

  

  4
• 1 You must be logged in to vote

  🙏

  Help Needed: Implementing QLoRA on AutoGPTQ Model - Unsupported Module Error

  SkanderGhariani asked Jun 14, 2024 in Q&A · Answered

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  AdaLoRA without update_and_allocate

  h4iku asked Jul 1, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  enable_input_require_grads is called twice with use_gradient_checkpointing=True and bnb quantisation; is there any effect?

  nzw0301 asked Apr 5, 2024 in Q&A · Answered

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  What are good configs for training UNet3DConditionModel on 8 GB VRAM? (64x64x64 inputs)

  RandomGamingDev asked Jun 3, 2024 in Q&A · Closed · Answered

  

  

  7
• 1 You must be logged in to vote

  🙏

  GPU Memory-Usage, full finetuning vs LoRA vs LoRA + CPU Offloading

  EthanChen1234 asked May 27, 2024 in Q&A · Closed · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Does inference with a PEFT model require all merged LoRA models or just the final saved LoRA and the base model?

  BGFGB asked May 29, 2024 in Q&A · Unanswered

  

  

  1
• 3 You must be logged in to vote

  💬

  rslora guidance for alpha value?

  andysalerno started Jan 23, 2024 in General

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Is there any reason not to use the tokenizer after applying LORA?

  seona21 asked May 16, 2024 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Trained layers with LoRA will be merged into model?

  lavinal712 asked May 12, 2024 in Q&A · Unanswered

  

  

  14
• 2 You must be logged in to vote

  🙏

  QLoRa with Vision Transformers

  anwai98 asked Apr 23, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  How can I train the adalora about nn.Conv1d?

  girlsending0 asked Apr 11, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  💬

  Qlora + Deepspeed Zero3

  AnirudhVIyer started Apr 9, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  prompt-tuning & p-tuning with Seq2Seq2LM t5

  whdnjsdyd111 asked Apr 5, 2024 in Q&A · Closed · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  The multi-task prompt tuning of PEFT library

  lhyscau asked Mar 25, 2024 in Q&A · Unanswered

  

  

  5
• 1 You must be logged in to vote

  🙏

  peft provides the position of the model input?

  ciaoyizhen asked Mar 19, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to train a custom model

  nguyenhoanganh2002 asked Mar 14, 2024 in Q&A · Answered

  

  

  12
• 1 You must be logged in to vote

  🙏

  What is the intended way of doing EMA with PEFT?

  samedii asked Mar 12, 2024 in Q&A · Answered

  

  

  10