What is a Web-Scraper?
According to Wikipedia, " Web scraping, web harvesting, or web data extraction is data scraping used for extracting data from websites. The web scraping software may directly access the World Wide Web using the Hypertext Transfer Protocol or a web browser. "
- Clone the repository
-
Using SSH
git clone [email protected]:FahimFBA/Web-Scraper.git
-
Using HTTPS
git clone https://github.com/FahimFBA/Web-Scraper.git
-
- Go to the Web-Scraper directory
cd Web-Scraper
- Run the project using the following command
npm run start
By default, it would scrap from The Guardian as I used The Guardian to experiment with the web scrapper.
To experiment on different websites, change the url in the index.js and customize the class in the axios as well.
Special thanks goes to Ania Kubów