LlamaTor is a community-driven project that provides a decentralized, efficient, and user-friendly method for downloading AI models. This tool enables the creation and sharing of torrent files for AI models, leveraging the robustness of the BitTorrent protocol to ensure model distribution is not solely dependent on any centralized site.
- Generate a JSON file with the structure of AI models using
generate.py
- Download all models from a JSON list using one script
download.py
. Next, using qbittorrent, you can generate torrent files.
- Run the
generate.py
script with the--user
and--filter
arguments to generate a JSON file with the structure of AI models:
python generate.py --user TheBloke --filter GPTQ
This will create a JSON file containing all AI models created by the user "TheBloke" that contain the word "GPTQ" in their name. This is really useful to create a torrent mirror of Hugging Face.
- Run the
download.py
script with the--output_folder
and--models_file
arguments to download the models:
python download.py --output_folder /media/user/models/ --models_file ./models.json
This will download all models listed in the models.json
file into the specified output folder.
https://github.com/Nondzu/LlamaTor/tree/torrents
Torrent files can be found in the torrents
directory within the torrents
branch. You can switch to this branch using the following command:
git checkout torrents
TODO: Create a script that will generate a torrent file after downloading a model.
LlamaTor is a community-driven project. We value your contributions. If you have any suggestions for improvements, find any bugs, or want to contribute in any other way, please feel free to make a pull request or open an issue.
-
Seed Torrents: After downloading a model, keep your torrent client open so that others can download from you. The more seeders, the faster the download speed for everyone.
-
Add or Build Your Own Seedbox: If you have a seedbox, consider adding it to the network to increase download speeds and reliability.
-
Donate: Keeping seedboxes online and renting more storage costs money. Any donations to support this project are greatly appreciated.
LlamaTor is licensed under the GNU General Public License v3.0. For more details, see the LICENSE file.