-
Notifications
You must be signed in to change notification settings - Fork 982
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
some Datasets are not available #1071
Labels
bug
Something isn't working
Comments
This is correct. The Pile has been taken down to a DMCA takedown request. |
hi, how can I access the Pile data? Thanks |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the bug
can not download the github/ArXiv dataset. the url is wrong
how to download github/ArXiv data? thank you
The code in corpora.py file, line 190:
class Github(DataDownloader):
name = "github"
urls = ["http:https://eaidata.bmk.sh/data/github_small.jsonl.zst"]
class ArXiv(DataDownloader):
name = "arxiv"
urls = [
"https://the-eye.eu/public/AI/pile_preliminary_components/2020-09-08-arxiv-extracts-nofallback-until-2007-068.tar.gz"
]
The text was updated successfully, but these errors were encountered: