A tool to unzip files in parallel.
This is a Rust library (and command-line tool) which utilises the power of Rust's rayon
library to unzip a zip file in parallel. If you're fetching the zip file from a URI, it
may also be able to start unzipping in parallel with the download.
To fetch the command-line tool: cargo install ripunzip
then ripunzip -h
. Alternatively,
a .deb
file is available under the "releases" section on github.
To add the library to your project: cargo add ripunzip
and check out the documentation
linked above.
Pull requests are welcome - see the contributing doc. The focus
of this project remains efficiently unzipping entire zip files, and any speed increases
are greatly appreciated! cargo criterion
is used for performance testing, though the
benchmark suite doesn't do a great job of simulating real conditions. In particular please
be aware that this tool is often used on devices with spinny hard disks and very limited
disk write bandwidth, so in different circumstances that may be the limiting circumstance,
or network bandwidth, or CPU time. Please consider the impact of your changes on all these
permutations.
Release procedure:
- Revise the version number
cargo publish
- Retrieve the latest
.deb
file from the latest CI job - Declare a new release and tag on github
- As you make that release, include the
.deb
file as an artifact.
There's also cargo fuzz
support for comparitive fuzzing against non-parallel unzipping
to try to spot any unforeseen circumstances where we do anything differently. If you
change the core unzipping logic please use this.
This is not an officially supported Google product.
LicenseThis software is distributed under the terms of both the MIT license and the Apache License (Version 2.0).
See LICENSE for details.