The goal of this project is to construct, analyze, and publish a dataset of monthly traffic on English Wikipedia from January 1 2008 through September 30 2017. The traffic data were collected by using two different Wikimedia REST API: Pagecounts API and Pageviews API. After the dataset was constructed, a time series plot was generated in Python.

If start with running the Jupyter notebook named 'hcds-a1-data-curation.ipynb' if all prerequisites list below are installed. If not, please first install all the prerequisites list below and then run the 'hcds-a1-data-curation.ipynb'.

Python 3.0+, Jupyter Notebook, Pandas, Matploblib, Seaborn

During data acquisition, user will need to collect data from two different API endpoints, the Pagecounts API and the Pageviews API.

Pagecounts API (Documentation) provides access to desktop and mobile traffic data from January 2008 through July 2016.

Pageviews API (Documentation) provides access to desktop, mobile web, and mobile app traffic data from July 2015 through September 2017.

Filename: en-wikipedia_traffic_200801-201709.csv

All the English Wikipedia traffic data processed in this assignment are finally combined into this CSV file as following:

year: year of the time stamp obtained from the traffic data

month: month of the time stamp obtained from the traffic data

pagecounts_all_views: number of page counts from all access (both desktop and mobile) obtained from the traffic data using Pagecounts API

pagecounts_desktop_views: number of page counts from desktop obtained from the traffic data using Pagecounts API

pagecounts_mobile_views: number of page counts from mobile obtained from the traffic data using Pagecounts API

pageviews_all_views: number of page counts from all access (both desktop and mobile) obtained from the traffic data using Pageviews API

pageviews_desktop_views: number of page counts from mobile obtained from the traffic data using Pageviews API

pageviews_mobile_views: number of page views from mobile obtained from the traffic data using Pageviews API

All the traffic data (i.e. number of page counts or views) exclude the traffic by web crawlers or spiders.

For the mobile traffic data from Pageviews API, the author combined both moible website traffic data and mobile app traffic data

Values listed as 0 in the table means that the traffic data were not available through Wikimedia REST API for the corresponding time stamp.

By using Wikimedia REST API, you agree to Wikimedia's Terms of Use and Privacy Policy.

This project is licensed under the MIT License - see the LICENSE.md file for details