scrapy
Here are 14 public repositories matching this topic...
Created a Master Slave Architecture for a distributed crawling system that will crawl a given list of reddit pages. Our master uses a custom weighted Round Robin algorithm to distribute URLs to the slave components.
-
Updated
Jun 9, 2017 - Java
A series of micro services build with spring-boot , spring cloud , angular4 and python scrapy .
-
Updated
Dec 18, 2017 - Java
🎊 Design and implement of lightweight crawler framework.
-
Updated
Jan 24, 2018 - Java
基于Spark的电影推荐系统,包含爬虫项目、web网站、后台管理系统以及spark推荐系统
-
Updated
Apr 1, 2019 - Java
Movie link database application for Tamil movies and dubbed movies
-
Updated
Mar 19, 2021 - Java
This project looks for songs and recovers the feeling they have that can be: very positive, positive, neutral, negative or very negative. Feeling attends only of lyrics.
-
Updated
Aug 14, 2021 - Java
Improve this page
Add a description, image, and links to the scrapy topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the scrapy topic, visit your repo's landing page and select "manage topics."