🌟 ArXiv Preprint

his repo hosts the code for the paper "Asymmetry in Low-Rank Adapters of Foundation Models". We discover and analysis the asymmetry of the LoRA adapter matrices B and A,

• Asymmetry in Low-Rank Adapters of Foundation Models
  • 🔗 Quick Links
  • Install Requirements
  • Usage
  • Experiments
    • GLUE benchmark
  • Bugs or Questions?
  • Citation

Step 1: Please follow the installation steps. First, make sure you have Pytorch installed.

pip3 install torch==2.1.2 torchvision

Step 2: Then install the rest of the required packages:

cd AsymmetryLoRA
pip install -r requirement.txt

TODO

TODO

TODO

If you have any questions related to the code or the paper, feel free to email Jiacheng Zhu ([email protected]). Please feel free to open an issue if you encounter any problems when using the code.

Please cite our paper if you find the repo helpful in your work: