This repository contains a web scraper and data analysis script for extracting and visualizing currency exchange rates from the website https://notowania.pb.pl. The web scraper is implemented using Scrapy, a popular web crawling and scraping framework for Python.
- Python 3.x
- Scrapy
- json_lines
- matplotlib
- numpy
- Install the required Python packages using the following command:
pip install scrapy json_lines matplotlib numpy
The web scraper (SpiderSpider
) is designed to crawl the specified URLs on https://notowania.pb.pl and extract relevant information. To run the scraper, use the following command:
scrapy runspider src/spider.py -o ../data/currency.jl
This command will execute the scraper and store the extracted data in JSON Lines format (currency.jl).
To run the data analysis script, use the following command:
python data.py
This command will generate three line charts (eur_pln.png, usd_pln.png, and eur_usd.png) in the public directory.