Build and test your own web scraper APIs with Next.js API Routes and cheerio.
For more info on building your own scraping APIs, checkout Create a public API by web scraping in NextJS by Michael Liendo and Build a web scraper with Node by Ayooluwa Isaiah.
To contribute to or make your own version of this project, grab the code from the repository and install dependencies:
npm install
Run the app in the development mode:
npm run dev
Open https://localhost:3000 to view in the browser.
Apply auto-formatting as you make changes:
npm run format-watch
This project includes Cypress integration tests. Run tests in a browser:
npm run cypress
Run headless tests:
npm run test
To run tests then push to main
:
npm run deploy
Vercel offers a zero-configuration single-command deployment.
-
Install
vercel
from vercel.com/cli or via node withnpm install -g vercel
. -
Run
vercel
from your project directory and follow the prompts.
Read more about the Vercel CLI here. You can also set up automatic deployments from git branches.
This project was bootstrapped with Create Next App.
Find the most recent version of this guide at here. And check out Next.js repo for the most up-to-date info.