This project provides a powerful web scraping tool that fetches search results and converts them into Markdown format using FastAPI, SearXNG, and Browserless. It includes the capability to use proxies for web scraping and handles HTML content conversion to Markdown efficiently.
python
markdown
ai
proxy
requests
openai
reader
scrape
metasearch
exa
fastapi
browserless
groq
httpx
jina
searxng
firecrawl
exaai
-
Updated
Jun 25, 2024 - Python