Automates weekly web scraping using Scrapy, shell scripting, and cron job scheduling to extract relevant articles from The Economist, and update to MongoDB Cloud, with email notifications function.
-
Updated
Apr 19, 2023 - Python
Automates weekly web scraping using Scrapy, shell scripting, and cron job scheduling to extract relevant articles from The Economist, and update to MongoDB Cloud, with email notifications function.
This repository contains two Python scripts that perform web scraping on HTML files
A scraper written using Scrapy that scrapes https://stagemarkt.nl/ for jobs, contacts and organizations. Outputs the data into csv.
A Task by Listed on topic of web scraping
I scraped data by parsing HTML (Requests and Beautiful Soup) and using API. Used Pandas to normalize scraped JSON data. Created an SQLite database. Stored extracted data in database and CSV.
Toko Alvabet Data Scraping and Price Comparator This Python script is designed to scrape data from Toko Alvabet's website and perform price comparison for the obtained products. It includes features for viewing and analyzing product data, as well as comparing prices with other sellers.
Telegram Bot - SGParkingBot
This crawls Wikipedia and extract the states and local governments area in Nigeria
News! News! Everywhere!, No news to read.
Quick Python Scraper to find out how far a topic is from Philosophy on wikipedia
You can get the data of trailhead scores as tsv-style.
Trending page on GitHub served as REST API
Unofficial class for scrap and recollect info from Filmmaffinity
Add a description, image, and links to the scraping topic page so that developers can more easily learn about it.
To associate your repository with the scraping topic, visit your repo's landing page and select "manage topics."