Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add progress bar to http_get #499

Merged
merged 1 commit into from
Oct 20, 2023
Merged

Conversation

WeixiongLin
Copy link
Contributor

I have discussed with the maintainer in issue-490, and encouraged to raise this PR.

Gist:
To use scispacy, some of the resources are fetched from web url, e.g. URL of tfidf_vectors_sparse. And the size of the resources could be up to 500M, thereby taking several miutes to complete downloading. Somehow scispacy download quietly without signals for users, so thet can't tell whether the progress stucks or not.

So I add a progress bar to the function http_get to let users know where they are.

Scispacy helps me a lot in my research, thanks for your contribution to our community. And thanks for your review.

@WeixiongLin
Copy link
Contributor Author

There was somthing wrong with my downstream repo so I close the old PR and raise this one again.
And I have checked the code format with black scispacy --line-length 88 by the way.

@WeixiongLin WeixiongLin reopened this Oct 19, 2023
dakinggg
dakinggg previously approved these changes Oct 19, 2023
Copy link
Collaborator

@dakinggg dakinggg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @WeixiongLin!

scispacy/file_cache.py Outdated Show resolved Hide resolved
Signed-off-by: Weixiong Lin <[email protected]>
@WeixiongLin
Copy link
Contributor Author

I have fix the problem, thanks for your help.

Copy link
Collaborator

@dakinggg dakinggg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!

@dakinggg dakinggg merged commit 0969c54 into allenai:main Oct 20, 2023
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants