Competitive Programming Crawler is a tool which will crawl all your codes from websites codeforces, codechef and atcoder using web scraping and automatically downloads the solution codes.
git clone https://github.com/aryan57/cp-crawlerDependency
npm install- First configure
options.jsonfile according to your needs - Then run the tool as follows.
node main.js
- Search all submitted source code and analyze and download source code.
- options.json
| option | Description |
|---|---|
| codeforcesHandle | Your codeforces handle (username). Leave empty "" if you dont want it. |
| codechefHandle | Your codechef handle (username). Leave empty "" if you dont want it. |
| atcoderHandle | Your atcoder handle (username). Leave empty "" if you dont want it. |
| onlyAC | true if you only want the accepted codes, else false. Beneficial to set it to true |
| overwrite | true if you want to overwrite codes when they are already present in the export directory, else false. It will be beneficial to set it to false,because if you run node main.js again, files will not be overwritten unnecessarily . |
| giveUniqueNames | true if you only want all the codes of the same problem, else false. When set to true different codes of the same problem will be differentiated using their unique Ids. It will be beneficial to set it to false,because generally we are concerned with any one code . |
TODO
Implment better scraping method for codechef :-