Moroccan housing data pipeline using scrapy, mongodb , zyte and digitalocean cloud
-
Updated
Oct 8, 2022 - Python
Moroccan housing data pipeline using scrapy, mongodb , zyte and digitalocean cloud
I have used scrapy framework to scrape data from the IMDB website of Movies like name, directors, actors, votes, duration, genre and imdb rating. i had uploaded this spider on zyte cloud platform to run on it and i scraped about 8 lakhs rows of data from IMDB of different genres.
Yet another bunch of cli utilities for Zyte's Scrapy Cloud.
A scrapy spider hosted on zyte created for "myanimelist.net/topanime.php" connected to a SQL cloud database for the Anime Dashboard. The spider creates a ETL pipeline using DataClasses and regular expressions.
Add a description, image, and links to the zyte topic page so that developers can more easily learn about it.
To associate your repository with the zyte topic, visit your repo's landing page and select "manage topics."