This program can take a Capterra category result and extract all of the data from every platform reviewed within that result.

• python 3.6+
• Chrome browser (tested on 73.0.3683.75)
• Chromedriver (install instructions)

1. make sure you have all the dependencies installed
2. clone this repo
3. cd into repo in your terminal
4. run pip install -r requirements.txt

1. use the Capterra site to select a category. Here is an example search result
2. run ./scrape.py <category page path>. Do not close or otherwise interact with the Chrome windows that automatically opened
3. once finished, the data will be saved in scraped_data/data.json
4. logs of each run are created in logs/