Skip to content

Backend, WebGUI and some custom spiders to host regular searches of scrapy spiders. User can hide matches to avoid repeative checks of same found items.

Notifications You must be signed in to change notification settings

otapi/salescrawler

Repository files navigation

About

Backend, WebGUI and some custom spiders to host regular searches of scrapy spiders. User can hide matches to avoid repeative checks of same found items. Still working in progress, 1st version with pip package coming soon... Main screen

Features

  • Webserver to provide webGUI on local machine
  • Store found matches in MySQL database
  • Crawlers: a set of spiders for a specific item with min/max price and notes
  • Spiderbots: Crawdy spiders with specific item to search or direct url for searchpage Main screen
  • Matches: can be hidden or saved as favorites.

See progress here

Install

About

Backend, WebGUI and some custom spiders to host regular searches of scrapy spiders. User can hide matches to avoid repeative checks of same found items.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published