Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update rayon iterator for fast failures #22

Open
gregl83 opened this issue May 31, 2024 · 0 comments
Open

update rayon iterator for fast failures #22

gregl83 opened this issue May 31, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@gregl83
Copy link
Owner

gregl83 commented May 31, 2024

Rayon is used to parallelize iterating over source paths and hashing file contents; however, if an operating system failure (e.g., locked file) occurs the iterator doesn't immediately fail.

A feature introduced the panic_fuse() function on rayon iterators that terminates iterator threads when a panic occurs leading to a fast failure and ultimately a failed attempt at producing a paq hash but without delay.

There is potentially a near negligible performance degradation that MUST be tested thoroughly if this feature is implemented.

@gregl83 gregl83 added the enhancement New feature or request label May 31, 2024
@gregl83 gregl83 self-assigned this May 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant