This project extracts the top 30 books on the shelves on goodreads and the most read books this week for six different genres: Science Fiction, Travel, Thriller, Poetry, Fantasy, and Business. The extracted data is then stored in a SQLite database. This project is useful for anyone who wants to keep track of the most popular books in these genres and analyze trends in reading habits. It can also be used as a starting point for building a recommendation system or for conducting data analysis on book trends.

TBD: Finalizing scrapy scripts

To install the project and its dependencies, follow these steps:

1. Clone the repository to your local machine.
2. Navigate to the project directory.
3. Run the run.sh script to install Poetry and the project dependencies.
4. Run the run.sh script to scrape the top 30 books from goodreads and store them in a SQLite database.

./run.sh scrape

5. (Optional) Run the run.sh script to run the project tests.

./run.sh unittest

1. (Optional) Run the run.sh script to do linting.

./run.sh lint