- Artifical Intelligence News
- Kyla Kaplan
- Elvira Baltasar
- Scrapy
- Pyterrier
- https://www.artificialintelligence-news.com/
- https://news.mit.edu/topic/artificial-intelligence2
- https://venturebeat.com/category/ai/
- ir // main folder
-
scrapy.cfg // deployment configuration file
-
middlewares.py // project middlewares file
-
pipelines.py // project pipelines file
-
settings.py // project setting file
-
spiders/ // where the spiders are stored
- _init.py // spider initializer
- example.py // example spider
-
In order to run the necessary spider:
- $ scrapy crawl NAMEOFSPIDER -o results.jsonl