Melbourne jazz gig scraper. The scaper is designed for:
- The Fitzroy Pinnacle - PDF
- The Rooks Return - Facebook Feed (seems empty for gigs)
- Arts Centre - Need a genre filter for jazz/blues/funk
- The Night Cat
- Dizzy Jazz Club - Once it reopens again
- Lido Jazz Room
- Ruby's Music Room - Relocating & might be dead
- Vamos
- Speakeasy HQ - Mix of genres
- Tranist Rooftop Bar - Sometimes not jazz
- Claypots Seafood Bar - Website down, only facebook at the moment
- Rainbow Hotel
- La Niche Cafe
- New version of Jaspers once it opens
- Candlelight Series
- Lebowskis Music
Spotted Mallard- Unfortunately they're dead
Notice a venue missing that should be on the list? Create an issue & we'll endeavour to add it in. Better yet, raise a PR with the scaper :)
First, ensure all libraries are installed:
cd ScrapeFromTheApe
pip install -r requirements.txt
To run a single spider, run:
scrapy crawl jazzlab
To run all spiders, run:
python crawl_all.py
The API is managed via the serverless framework, using an AWS backend. To deploy, install the dependencies then run deploy using your desired AWS profile.
npm install
sls deploy --aws-profile <profile-name>