BookDataScraping

Part I. Data Collection:

Created a scraping infra to scrape the following website:
- https://books.toscrape.com/
The data contains the following 2 classes with the features listed:
- Books
  - Name
  - Image Link
  - Rating
  - Price
  - In-Stock or not
  - Category
- Category
  - Name
  - Link

Created a sqlite database pythonsqlite.db a warehousing infra to store the above scraped data in a sqlite.
This database contains two tables:
- books_table
- category_table

Store the data in Cloud Object Stores like S3. A method to write data is defined, providing the configuration details in config this can be used to save the file in cloud store s3
Airflow like scheduler can be used to configure and trigger this job.

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
config		config
docs		docs
output		output
LICENSE		LICENSE
README.md		README.md
database.py		database.py
pythonsqlite.db		pythonsqlite.db
requirements.txt		requirements.txt
solution.py		solution.py