Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Prefer using aria2 instead of wget #14

Open
arguiot opened this issue Mar 12, 2023 · 5 comments
Open

Prefer using aria2 instead of wget #14

arguiot opened this issue Mar 12, 2023 · 5 comments

Comments

@arguiot
Copy link

arguiot commented Mar 12, 2023

Aria2 is a much faster downloading utility.
https://github.com/aria2/aria2
You can easily fix your script by replacing all the wget occurrences with aria2c and lower case the -O

@nelsonjchen
Copy link

I guess much faster way would be to use aria2's multi-connection download capability. From hosts with very high capacity bandwidth like 300Mb/s +, this would help noticeably. 16, split, simultaneously? Very fast.

https://stackoverflow.com/questions/55166245/aria2c-parallel-download-parameters

My suggestion would be to opportunistically use aria2c if it's available with fast parameters set.

@nelsonjchen
Copy link

But curl and wget must support multi-connection from different replicas and ips on DNS already...

Do you have any examples? I cannot find any documentation on how this can be accomplished. In fact, I find the opposite as all documentation seems to point to curl/wget being only able to handle a single connection at a time for a single file.

@BrunoFerreira95
Copy link

Reading this GitHub, I realize something about making a download split by number and use Node Streams solution to make multiple download of one file split ready the files and groups all in the end

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants
@nelsonjchen @arguiot @BrunoFerreira95 and others