Welcome to the G2 Scraper, a powerful tool designed to scrape G2 Products.
If you're looking to learn more about your competitors or gather G2 Products in a specific category without the hassle of manual copy-pasting, you've come to the right place.
This G2 scraper is well-maintained and saves data in both CSV and JSON formats for easy use.
Below is a sample showing the data that will be generated in CSV and JSON formats:
1οΈβ£ Clone the Magic π§ββοΈ:
git clone https://github.com/omkarcloud/g2-scraper
cd g2-scraper
2οΈβ£ Install Dependencies π¦:
python -m pip install -r requirements.txt
3οΈβ£ Now, you can proceed to scrape product links and store them in the pending.json file π. If a Captcha appears, you will be asked to solve it manually. Execute the following command:
python main.py
4οΈβ£ Now, change the scraper to "ExtractProducts", open the config.py file, and make the following modification in the SCRAPER variable:
# SCRAPER = 'ExtractProductLinks'
SCRAPER = 'ExtractProducts'
5οΈβ£ Run the following command to scrape product data, which will be saved in both finished.csv
and finished.json
:
python main.py
β The scraper is getting products from the sales-intelligence category. How can I scrape products from another category (x category)?
A: Open the file src/config.py
and set the category_url
to your desired category URL as follows:
category_url = "https://www.g2.com/categories/YOUR_CATEGORY"
We offer a G2 Reviews scraper for extracting Product Reviews, which can be used to reach out to your competitors' customers. Feel free to reach out to us at [email protected] to request the scraper. The Scraper Cost is $250 and you will get high ROI as that data will help you see win your competitors' customers.
The G2 Scraper project uses the Bose Framework, a web scraping framework that is the Swiss Army Knife for web scraping. I encourage you to learn more about the Bose Framework at https://www.omkar.cloud/bose/