A collective list of free APIs

FastAPI framework, high performance, easy to learn, fast to code, ready for production

The official gpt4free repository | various collection of powerful language models

⏬ Dumb downloader that scrapes the web

Scrapy, a fast high-level web crawling & scraping framework for Python.

A simple, yet elegant, HTTP library.

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

Saleor Core: the high performance, composable, headless commerce API.

Google Chromium, sans integration with Google

Pythonic HTML Parsing for Humans™

Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)

Visual scraping for Scrapy

A self-hosted open source photo management service. This is the repository of the backend.

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Persepolis is a download manager written in Python.

💬 Telegram bot with ChatGPT, Python-based, using OpenAI's API.

实战🐍多种网站、电商数据爬虫🕷。包含🕸：淘宝商品、微信公众号、大众点评、企查查、招聘网站、闲鱼、阿里任务、博客园、微博、百度贴吧、豆瓣电影、包图网、全景网、豆瓣音乐、某省药监局、搜狐新闻、机器学习文本采集、fofa资产采集、汽车之家、国家统计局、百度关键词收录数、蜘蛛泛目录、今日头条、豆瓣影评、携程、小米应用商店、安居客、途家民宿❤️❤️❤️。微信爬虫展示项目:

Web Scraping Framework

CMS Detection and Exploitation suite - Scan WordPress, Joomla, Drupal and over 180 other CMSs

Python package for scraping recipes data

🤖 Scrape data from HTML websites automatically by just providing examples

101 real world web scraping exercises in Python 3 for data journalists

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

🥫 The simple, fast, and modern web scraping library

Scraping details of products from ecommerce websites using python

Скрипт для автоматической авторизации в сетях московского общественного транспорта

personal finance tracker, written in python 3 and using the wxPython GUI toolkit.

A typical freelancer's site with services description, portfolio, bio, contacts and order form.

Using the Scrapy framework to scrape data consisting of name, brand, rating, price, product URL and image URLs of laptops on Jumia e-commerce (https://www.jumia.com.ng) into XLSX, SQL and MongoDB.