Data Wrangling & NLP on Local Used Items

Overview

I wrangled 10,000 local used items around me from Craigslist.org, letgo.com, and Facebook Marketplace. I then performed EDA with Python and Tableau. I also built a few simple extractor and classification NLP models using MonkeyLearn API. You can view the interactive visualizations I created in Tableau here: https://public.tableau.com/profile/keenan.burke.pitts#!/vizhome/NYCDSAFinalProject_0/LocalUsedItemsAnalysis

You will need to download the Scrapy Framework https://scrapy.org/ to scrape items from letgo.com and craigslist.org. You may need a paid crawlera account https://scrapinghub.com/crawlera to avoid getting blocked from Craigslist. You will need to use Selenium https://selenium-python.readthedocs.io/ for scraping Facebook Marketplace. You will need to download Tableau software https://public.tableau.com/en-us/s/download for the visualizations or you can simply interact with them on my public profile. You will also need an account with MonkeyLearn https://monkeylearn.com/ to connect with their API to execute the NLP models.

Name		Name	Last commit message	Last commit date
Latest commit History 6 Commits
.ipynb_checkpoints		.ipynb_checkpoints
final_project		final_project
.DS_Store		.DS_Store
Craigslist_items.json		Craigslist_items.json
FBM_selenium.py		FBM_selenium.py
Facebook_items.json		Facebook_items.json
Letgo_items.json		Letgo_items.json
README.md		README.md
all_items_cleaned.csv		all_items_cleaned.csv
cl_items_cleaned.csv		cl_items_cleaned.csv
cl_used_items_filtered.txt		cl_used_items_filtered.txt
fb_items_cleaned.csv		fb_items_cleaned.csv
fb_used_items_filtered.txt		fb_used_items_filtered.txt
final_project_EDA_and_NLP.ipynb		final_project_EDA_and_NLP.ipynb
final_project_data_wrangling.ipynb		final_project_data_wrangling.ipynb
geckodriver.log		geckodriver.log
lg_items_cleaned.csv		lg_items_cleaned.csv
lg_used_items_filtered.txt		lg_used_items_filtered.txt
nlp_items_cleaned.csv		nlp_items_cleaned.csv