Skip to content

Mogady/FAQs-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FAQ scraper

Introduction

This project using Scrapy tool to scrap FAQs from companies' helpCenters.

Build the docker image

To build the image run:

$ docker build -t scraping.

Run spider

$ docker run scraping spider-name

to run one of the examples

$ docker run scraping zappos

Extra

you can use Mongodb pipeline, by simply changing the pipelines in settings.py