Skip to content

mrorii/tabebot

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

tabebot

A minimal crawler for tabelog, written on top of Scrapy

Quick Usage

git clone https://github.com/mrorii/tabebot.git && cd tabebot
pip install -r requirements.txt
# Modify `USER_AGENT` in tabebot/settings.py

scrapy crawl tabebot

This will start writing out scraped results to:

  • business.json
  • review.json
  • user.json

in the working directory.

Crawl responsibly.

Screenshot

Example output:

About

tabelog crawler

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages