Skip to content

jroller33/Crawl_and_Scrape

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

30 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Python Web Crawler and Scraper

License: MIT

Description

Usage

clone the repo, create a venv, and install scrapy:

pip install Scrapy

in scraper/ directory, run:

scrapy crawl ecom_spider

Log files:

IMDB Crawl Log

Contribution

You can contribute by forking this repo and submitting a pull request.

License

This project is licensed under the MIT License.

Contact

GitHub