Clus-DBSCN-weather-py-v1.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a href=\"https://www.bigdatauniversity.com\"><img src = \"https://ibm.box.com/shared/static/cw2c7r3o20w9zn8gkecaeyjhgw3xdgbj.png\" width = 400, align = \"center\"></a>\n",
    "\n",
    "# <center>Density-Based Clustering</center>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Most of the traditional clustering techniques, such as k-means, hierarchical and fuzzy clustering, can be used to group data without supervision. \n",
    "\n",
    "However, when applied to tasks with arbitrary shape clusters, or clusters within cluster, the traditional techniques might be unable to achieve good results. That is, elements in the same cluster might not share enough similarity or the performance may be poor.\n",
    "Additionally, Density-based Clustering locates regions of high density that are separated from one another by regions of low density. Density, in this context, is defined as the number of points within a specified radius.\n",
    "\n",
    "In this section, the main focus will be manipulating the data and properties of DBSCAN and observing the resulting clustering.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Import the following libraries:\n",
    "\n",
    "<ul>\n",
    "    <li> <b>numpy as np</b> </li>\n",
    "    <li> <b>DBSCAN</b> from <b>sklearn.cluster</b> </li>\n",
    "    <li> <b>make_blobs</b> from <b>sklearn.datasets.samples_generator</b> </li>\n",
    "    <li> <b>StandardScaler</b> from <b>sklearn.preprocessing</b> </li>\n",
    "    <li> <b>matplotlib.pyplot as plt</b> </li>\n",
    "</ul> <br>\n",
    "Remember <b> %matplotlib inline </b> to display plots\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Notice: For visualization of map, you need basemap package.\n",
    "# if you dont have basemap install on your machine, you can use the following line to install it\n",
    "# !conda install -c conda-forge basemap matplotlib==3.1 -y\n",
    "# Notice: you maight have to refresh your page and re-run the notebook after installation"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import numpy as np \n",
    "from sklearn.cluster import DBSCAN \n",
    "from sklearn.datasets.samples_generator import make_blobs \n",
    "from sklearn.preprocessing import StandardScaler \n",
    "import matplotlib.pyplot as plt \n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Data generation\n",
    "\n",
    "The function below will generate the data points and requires these inputs:\n",
    "\n",
    "<ul>\n",
    "    <li> <b>centroidLocation</b>: Coordinates of the centroids that will generate the random data. </li>\n",
    "    <ul> <li> Example: input: [[4,3], [2,-1], [-1,4]] </li> </ul>\n",
    "    <li> <b>numSamples</b>: The number of data points we want generated, split over the number of centroids (# of centroids defined in centroidLocation) </li>\n",
    "    <ul> <li> Example: 1500 </li> </ul>\n",
    "    <li> <b>clusterDeviation</b>: The standard deviation between the clusters. The larger the number, the further the spacing. </li>\n",
    "    <ul> <li> Example: 0.5 </li> </ul>\n",
    "</ul>\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "def createDataPoints(centroidLocation, numSamples, clusterDeviation):\n",
    "    # Create random data and store in feature matrix X and response vector y.\n",
    "    X, y = make_blobs(n_samples=numSamples, centers=centroidLocation, \n",
    "                                cluster_std=clusterDeviation)\n",
    "    \n",
    "    # Standardize features by removing the mean and scaling to unit variance\n",
    "    X = StandardScaler().fit_transform(X)\n",
    "    return X, y"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Use <b>createDataPoints</b> with the <b>3 inputs</b> and store the output into variables <b>X</b> and <b>y</b>.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "X, y = createDataPoints([[4,3], [2,-1], [-1,4]] , 1500, 0.5)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Modeling\n",
    "\n",
    "DBSCAN stands for Density-Based Spatial Clustering of Applications with Noise. This technique is one of the most common clustering algorithms  which works based on density of object.\n",
    "The whole idea is that if a particular point belongs to a cluster, it should be near to lots of other points in that cluster.\n",
    "\n",
    "It works based on two parameters: Epsilon and Minimum Points  \n",
    "**Epsilon** determine a specified radius that if includes enough number of points within, we call it dense area  \n",
    "**minimumSamples** determine the minimum number of data points we want in a neighborhood to define a cluster.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([0, 1, 1, ..., 1, 1, 0])"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "epsilon = 0.3\n",
    "minimumSamples = 7\n",
    "db = DBSCAN(eps=epsilon, min_samples=minimumSamples).fit(X)\n",
    "labels = db.labels_\n",
    "labels"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Distinguish outliers\n",
    "\n",
    "Lets Replace all elements with 'True' in core_samples_mask that are in the cluster, 'False' if the points are outliers.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([ True,  True,  True, ...,  True,  True,  True])"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Firts, create an array of booleans using the labels from db.\n",
    "core_samples_mask = np.zeros_like(db.labels_, dtype=bool)\n",
    "core_samples_mask[db.core_sample_indices_] = True\n",
    "core_samples_mask"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "3"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Number of clusters in labels, ignoring noise if present.\n",
    "n_clusters_ = len(set(labels)) - (1 if -1 in labels else 0)\n",
    "n_clusters_"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{0, 1, 2}"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Remove repetition in labels by turning it into a set.\n",
    "unique_labels = set(labels)\n",
    "unique_labels"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Data visualization\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Create colors for the clusters.\n",
    "colors = plt.cm.Spectral(np.linspace(0, 1, len(unique_labels)))\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX0AAAD4CAYAAAAAczaOAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy86wFpkAAAACXBIWXMAAAsTAAALEwEAmpwYAABiUElEQVR4nO39eZRk133fCX7u22LPtSprRS0ACjsJkCyCqyTQAi0I1pgSmxYpuceU1dO01FS3rdN2m92aI7rlnrE0mm5atilLbFqi1CNR5mhIgi2ClLiIIikSJApLASigANS+ZFXlnpGxvu3OH/fdjJeREblUZmVGZt7POXkyMuLFezdeZv7uvb/l+xNSSgwGg8GwM7A2ewAGg8Fg2DiM0TcYDIYdhDH6BoPBsIMwRt9gMBh2EMboGwwGww7C2ewBLMWuXbvkkSNHNnsYBoPBsGV45plnJqSUu7u93tNG/8iRI5w4cWKzh2EwGAxbBiHExaVeN+4dg8Fg2EEYo28wGAw7CGP0DQaDYQdhjL7BYDDsIHo6kLtZRE2f6VMXaE6WyQz3MXj/EeyMt9nDMhgMhjVjjH4blUs3OPWJP8efroAQICXeYJH7f/UDFA/t2ezhGQwGw5ow7p0UUdPn1Cf+HBlJikf2Ujy8h+KRvchIcuoTf07kB5s9RIPBYFgTxuinmD51AX+6QmaotOD5zFAJf7rC9EvnN2lkBoPBsD4Yo5+iOVlWLp1OCKFeNxgMhi2MMfopMsN90K2pjJTqdYPBYNjCGKOfYvD+I3iDRZpTcwueb07N4Q0WGXzg6CaNzGAwGNYHY/RT2BmP+3/1AwhbULlwncrFG1QuXEfYgvt/9QPYnrvZQwRUwHni2de4+rUTTDz7GlHT3+whGQyGLcK6pGwKIf4A+ClgTEr5QIfXHwGeAHQk9PNSyt9Yj2uvN8VDezj+Wx9h+qXzrTz9B472jME3KaUGg2EtrFee/meA/wD88RLHfEdK+VPrdL1biu257HrzXZs9jEW0p5RqmlNznPrEn3P8tz6y4snJFKAZDDuTdTH6UspvCyGOrMe5DIvRBnr8qZcpnxll6ME7FryeGSpRuXCd6ZfOr2iy6rRbcEo5Dv7kw1iuYyYBg2Ebs5EVue8QQpwERoF/LqU81ekgIcRHgI8AHDp0aAOHt/l0Wn3Xb0zPG+jqtUkq567RGJ9h5B334fUXW29eYUppp92CP1vh2rdOcu2bzzF8/C4sYRmXkcGwTdkoo/8scFhKWRFCPA58ETjW6UAp5aeATwEcP368S/7kxrPe7pD287mlPKd/94lFq++w1sQt5FRlsIDZ05eoXB2n8X9+n0PvfzdePqdOuMKUUl2Apg1+HEaMff9lLM9R18xmyO8bvimX0VKfz+wcDIbeYEOMvpSynHr8pBDid4UQu6SUExtx/bWy3sHT2dev8Ny/+gyNsVnsXAa3lGPmlYsMP3jnAl/9zOnLTL94lsPv/xGql8e4+pUf0pypANCUkjN/8FUOv+9dOIXcilNK2wvQGuMzRA0fb6CI74eE9SawepdRGhNsNhh6lw1J2RRC7BVCWRohxMPJdSc34tprZb31eGZfv8Jff/A3mHruLI3xGaqXbjD9wjmCco2ZVy4SR9H8sZZrETUDqlfGufzkD5BAdnc/tuciLPXaxS/+LXEULZlSmk7xrI/PIMPWNcJao3WglDi5TOvnm6hCNvpFBkNvs14pm58FHgF2CSGuAB8HXAAp5e8BHwB+WQgRAnXgQ1J2K33tLdrdIZqbWQlHTZ/nPv5HRHWf3J7B+edr16cIyjWcfJbG2Az5fcMAOPksQgjKr18l8gO8Uh4Ab7BIMFvFKWaJw5ihN9/ZdQXdvuqOo4jpU+cRjk3x8B6cfFaNre5j5zyyIwOtN99EFfJ63i+DwbD+rFf2zs8t8/p/QKV0bjnWU49n+tQFGpOz2NmFvm23mJt3s2j3CkB29wCW6xCUa+gRxFGkDLiUxEFMVG/y+n/6Cvl9w9htmTfdUjwt22Ly5Bm14heC2A9BwL5HHsKybfW5b7IK2egXGQy9jdHTX4b11ONpTpaxM+6i8zmFLMK2CBtNwmqD8rlRnFwG4dqMvOM+KlfGqFy4TtjwCedqIATeYAnLsYmbAbWrE5z457/PruN3Iywx7z9vTMx2XHUXD+8ljmL2P/ZWcrsHOPKhR7j61afxpyv4M9UFPvjVBnGNfpHB0NsYo78MaT2etOSyXgn3HTvAxLOvrShLJTPchzdQVKv6xJ0CIITAzedozlYYe+oVIj/AEuANlHjX//7fM3D/YZ589z/Fn6tjZzM4ReX2CetN4iAks6ufsFKnMTlL4eBuoiDk1Cf+nH3vfUvXVbdl2+R2D3DgvccBOPDoW9alCnm5+2X0iwyGzcUY/WXQejynPvHnVC5cX5CNcvRnH+G5X/8MzYkyjekyjckybi7Dvf/0/dz22MMAC9IW++7cT3a4D8s+xMzpS/gzys8e1psEczWcYpZgpoqMY2LHJp6Y5fsf/bf8+Bf/F37kD/8Hvv1//TfU5mpQqSNRk0V2pJ/G2DRRtclMEFE+cxVhWRQO7mLooTuXXXW3p1bu/dE3rim1cqn71Uv6RQbDTkX0cjz1+PHj8sSJE7f8Ot1yytPPu315kBDM1ZQBP3aA5379M/gzVSZPnqF2ZRwZxsSxxLIt9v2dh3D7ChDFiyaK85/7Fo3JMv5MhagZEDWaTJ08S9wMwRIIIRC2hZ3PEDdDDrz3OD/6f3yM8R++womPfZo4CLFcBzvnMfX8GeyMR+wHgEBYAhnFxGHIyLvfSG5kALeQW7TqFrbgno/+NKc/+cVbkloZ+UHP6hcZDNsZIcQzUsrj3V7f8Sv9bjnl2jh3M4gTz75Gc6LM7GuXqV2bxPJcrLwKgvpzNUa//izFQyPc9vffuSA4ev5z3+JN//ofU37tigpqWoKn/tt/R1T3QQhsx0EIgYwlUa2JcCwql24w/dJ5cnuGCCt1/Nkawoaw1iScq6t4QN3H7ctjOQ5xEBI3fJoTs2SHS0gkc2dHac5WiepNsiP9vPF/+oec/uQX10XHpxO9ql9kMOx0drS0crec8igI+d5Hf4fYj7rmmjcnyzRnqzRnKggJlmPPn1cAcRQTNnwaYzPzz+u2i+XXrrDrzXfhFnM89dF/x9zZa8ggQvohYaVO2AyQUiKjGBnGSCTVy2M8/S9+j+bMHM3pMo2xGZozFWI/xJ+uYGdchCXwp+fwZyrIMKQ+Ns3E068y9MajxFFM1FRxBGHbvPD//BOqV8Zx+/PUrk1SPjdK7dokbn9+vjWkkXA2GLYfO3ql3y2nXAYRYblGHIYLnk/nmmeG+4jqTWQULQiWSimJ/BAZx4S1JkGlvvCiSdqiX67wvY/+DmG9oVwy8ycA2QyIglCt/LMeRDHP/8b/wexrV9RK3g+RUYSwLKSt3DlhwydK0j2FY2HZrtoB1Jq88Juf5cBjD9N/18H5YUw+f5bpl89TvTRG1AxACGQcQyzxhopcefIHvPrpL1O7PEHUDLAzLsUje3jDv/igqao19BAxUAUCVGlQgR2+ll2WHW30u+WUh/UmMgmwLiIx2nt/9I1kR/opn706HyyNw0j56YMI4pjmZJmxv30JGUXYuYxanU+VqY1OcvELf0tQrhE1gs6x1lgCkqjhM3P6EnY2Q+T7xM0AiUx2E5FyBUUxMgixchnsjEtYbRBHgTp/vYmMpWr4PlCiMT5DWGsgkTTGZrA9BzubIaw1aE6WkVFM5fIYc+euEzf9+VoBgOqVcaJak3f8x39m/POGHqABXAbSizMHuA3IbsqItgI72uh3yyl3chlEuySBJsl6sTMeb/pXv8A3/4t/pVbu1TqyqVbg2BZEMXHsU7s+xcUv/i1CCGU8LcELv/VZ7HyWsKYmFRnFS4xSIuOYqN6AKEbGKP+R6yBiieU5RLGPDCPCepOo0QRLYHseUcNXWT6WYPwHr1B+/Qr+bBUZRcRBRFRrUr0yjpPNEMzV5o9FWISVOlbGxS9XKd2+fz5FdOz7LzP53OuMvO2+dfgNGAw3S4wy+JKFBj5Inr8Ds+LvzLYz+qtRd+yWUy5cGycJiqZpzzW3My7DbzlGc3KW+o3pZHUOhDFYAivjqqyaSIJrI6Wk/66DxLWA6qUbhBWVdy9sS7lW2ucfIRCeh/RD4pReDhJkEIJtEQehmrgEEEbzc1joh6hsHnXuajBBY3wGYVkI2yIOI2QYETcCIttGxhLhWIBQ15ISr7+gqoSrDdxiDieXwZ+aY/KZpY2+Udg03HqqqBV++4reRe0AqkCp/U0GtpnRX62641I55e/85D/l/Oe+1TXXXAeB7YyLN1hKcu3ryj8fx9jZDDKOEbaNjELsjIflOVQvjoEQRI2AuBkqCQTHRtg2CFpiaI4NUiIbfudcewmE8YJYwDyWUBOGJdTOIwbZCAgbAbg2lm0hw3j+bU42A7HEznlYrkNjfKZ1TSHUxKIvIyWLZ6eb/x0YDDfHcsJ9RtivG9vG6N9sK8GleuIOv+Wurrnm06cuUL0yzuyrl6mPTiojGktkOkQQK9cMQvnfo0qA5TkIlHG3Mi5xwwc/VO+zBFgW2Ba2bavArBBqFS9EayexHEk8QEqx2D4HyrWjkX5Is1zFzXrYnqtqADIexPH8il/79KO6n+xuOqdirmc7R4NhaZb7OzJ/Z93YNkZ/LeqO3XLKl8o1r12bZObli8hI+dVFxiVqNNUCOZZJgVSkirOAuK7SHaMgQtgWwrGxPIfs7n5qoxMglDtISiAIiZOVtnAstbqOExfOamrplpok9LkEIGOCqgru2tkM+T1DgKQxWVZzTRgm1cOw++33Mfymjv1vjMKmYQMpoMyXztrRBMnzhc0Y1JZg2xj9jVZ39GerxM0Ad6CIPzOH7ToI20GGIUiIm37n8UiJTPzpSEkwV1OuoCiieHCExuQs/mwIYYRw7XklzPkv2wI/XHze1SJb372BonIHIYijmOZUGW+4HyefoXT7PizPTVI29/KGf/6zXVfrRmHTsHFYqCydyygfvkZn75ggbje2jdHfaHXHTH8RK+POG+PmVBmQ8yt7JN3HkxpX1AiIwxBhWUpds5hTufhNH6lX6lKCJbELWWI/WtVifyU0xmYhjrHzGaK6j7AEQbWON9xH9eokh//+Oyndvpfht9yFN1DoKjDX7XcQRxGNyVnKr181gV3DOpJFZemYPP3VsG2M/nqqYS5H1PSpT8xgeS6N8RmCSp2o1lSuEivle1/GHaMyb9RjiZoswplqUtLb9sYYorkG643IOEg/AiGJKg2l/eMo+Wd/co4oU+e1P/wKt/3k27j2189TPjtK3+37cUt54ihChjEH/97DlO7Yr6qDy1VmXr1E350HsGw7abr+PHEzZPypV5j44WkT2DWsIxbK0GvDX8UY/qXZVoJrN6ujs5oUw8qlGzz/P/8xN75/ivq1KSI/UP56gQrCLplz34NYFsi2dFFbqDqAIEK4DnbWY8+7H2Du3DX86SqWa7HrrXdTuXSDoFxHRrGKU1iC4tG9VM5dBwH99xxi9vQlLM9l3yMP4vUXgZbgmwnsbmc2qlLWFGi1s5zg2rYy+rBY3VGrYcpIdlSavPejP80rK1CajJo+E8+9zov/5rPMnL6E219ACMHU82eQqWyY7YbwHLAt5e9vNpnfvgiBW8xTunM/1Qs3yO4ZxC3kwIK973mIyrkb1MemcHMZht58bF50TlO5cJ17/7ufMYHdnmK9DPVGGeIYOItasbQHcwU7tUBrQ1Q2hRB/APwUMCalfKDD6wL4HeBxoAb8gpTy2fW4djvtGTcTz77WNaOkfG6UZz/+h2SHB5ZMMdQ7iPKZUaZOniGoNghrDTKDJayMq2QXtikyCRq3lgatCHAwW2XmpfNYSaN2O+fhz1TwJ+cYuOc2mtNlsO1FBh8wgd2eY70M9XpVyq5kAjIFWjfDek2DnwEeW+L1nwSOJV8fAf7jOl13WZbKKPFnKjTGZxfsAKClhqmVJl/87f9M7do0Ya1BHEmQEM41mDt3rRVs3aHEvpJ/EHbyp5TSLLKTNNaOrDC4bpQ+N4J2Q62/ZPL8alyW2hC3u+3c5PnqCs7RQK3grwA3ku9nWZilA6ZA6+ZYr8bo3xZCHFnikPcBfyyVL+kpIcSAEGKflPLaelx/KZbK6omaAXa2g74OgBDUr01x/bsvculL38PylJBZ48ZUkt8uls/O2QlIqWyCABnLeeG2Wi6DW8rh5DPMnL6M5Vo4+SzZ3QME5dqKWiea6t6NYj1WzHplPokythmUi6Wd5QzxanYKqynQWq3ravuqd25U9s4B1G9McyV5bpHRF0J8BLUb4NChQ2u+8FJZPdnhfiy78y8ymKtx5o+/xthTL9OcnoNEj77l3djmBj+dhbQUQmB5Lv5slfq1KWQUUb06zty5awhbMHDfYWZOnSdqBvOicyPvuI83fOznFlY7twXPTXXvRpI2xBLwgQiwk5+XM9Rp15CP8uD6QD/KxOhzNoAmMJucv5MxXWoCqgNjgJf8nGNlBVrdXFcHknG0G/btHRzeKKPfacrvaFGklJ8CPgUqkLvWCy+lr/Om//nDnP7dJxZNCPXxGcrnRuk7dgDLc5S6ZdcRb1NW6LYSro3bn6c5UUY4Fvm9QwgEbilHWG1Qfv0qh973LpqT5flG7nEc8/K//wJhudZ1BW+qezcSbTBDlEFOu3MkMLLEe9Mrc71rrqMM6SzQB5STc0vgIsocFFCTig0MoYyti5oUOhEm52nSMrwOsAsYRU0WdvKcS6tAq9vOoQ68BBRpmSc9EVztcPz2Ue/cKKN/BfVb0BxE/aY2hKX0dTpNCFEQ0HfHfrWS1PGAtA1Mu3acJE1zJ00ICe5gCa8/T/HQCHY+Q37/bmI/wMlliKOYyROvglRxlfy+YUD1HLj4+e8w+ODtDNzd2sm1r+BNde9Gog3wNMoAarMQJ19TtAxzO3pl7iTHae3vIPlq0jLGcXIOiVpN9yXXnKBlYGVyTNo9JFETCKjVfXpyeZ3WCj1Ojj2QOl+nnYNE7Ub0ePT5AuB8ct1c2+fcPsHhjTL6XwJ+RQjxZ8DbgNmN8OfDYpnfvT/6xgVuhE4TQu36FOf/818TVhqElRqW5yo1zHbXjmB7Gvx0UZktlDR0O66NnXXY864HOPDYW7n29ecoHtw9/3L57FUA1erxyjhhvTk/GejG7mnaV/CZ4T5kGFG7NklYa8zHA6xEfXS9K6x3NhbKqE8lj8PU84O0ArCdjF3AQqOsf68uLcM6lDw3lxwrk3NOJt9jFrpS9HkHk/P5tCYW/b+bNtw2kE+97yqtFXkn15RPa3Jq0nJlecnntFhs9NPj2tqsV8rmZ4FHgF1CiCvAx0n2jFLK3wOeRKVrnkH9pv7xelx3OVYaCEynefrlCuc++02ufOWH2FmPoNYkbvjKzeM6EIQto7jdjL0m/bmi1ARnW6pXAKimKo2A699+gcyufhoTs+QP7JrvFezks8RBSGN8hqju44xOql1U0ycOw84NalIreLeUZ+rUeeKGUiYFsLMeA/ceXlEQ2LBaLNTKW6+YLZQRFCiD227sdKCzhloBxyw2J3pVr1f+us4DlKFNv0egDK/eXUSoSaiEMtICFSPQ79eGW49X074i7xT30dfWE5bewVi04hjd2PpxpPXK3vm5ZV6XwEfX41or5WYCgWPfP8X3fvnfMnfhOlGjSVCuqUpTIdRKP1bNURYEcVerfLkV0Z8xUjLRlucipSSuNalX6pz+j1+icHA31Svj7Hn3G4j9AH+2Qm10EmFb5PYOIRJXTW10Er9c67xST1bwUdPn9O8+wfCDdzBz+hJRXYnX+bNVJk+e4e987uMmiLvuuKhfdJdstgXGLh3olCg3S4RabWsDqlfPUfJVpfWPImgZ6vSuQn+PUSttPRFp11HaXEVtj+u0JoQGaudRoLMap4WaNPTElj5PE+Xn377qndtGe6ed1QYCdaPyoN7AyXq4pRzBbI3ID1pKlzLGzmdVxyk/SBYJlpoMYPsaf7nwe5w0bReujZPLJKJxEVHT59yffgNvsKjuWxRjuQ7Nidl5d443UAApmTt/bZFPX6/gp186P/+7yx/cTWNsZt49FNab+OWV5HobVsdKpYo7BUYlylVTpzVpSJThrqKMcMDS+f561a4Ndzq2oOMBFVqrcYvWhKLfr3cjNmqSqKNCie1qnLrWo11qRV97DzBDd/XO9Urn3Jy00G1r9FcbCLz0F08Rlms4hSxhuY5l27gDBeLxWSTgDRaJm6HSzs9ZRPUmYa3RElnr5PferiRNWkjcLghV8+AWc7j9efrvVjH72pUJhOcQN3wG7j+CW8yRHRlg9vRl4mbQtStZ+ndn2fZ8EBigcvGGCeLeEjpJFWsf5jAtIbNOgdFc8qUnCG18a8n79Spfr/wX9QVNvofJMdrVM5ucw0KtwP3keT1eXQ9g0zLkemLJ05qgjqIykOZSx+hzpmMJFmqVb9NdvXO90jk3Ly102xr91UotVy+NIXXzcimJwwh/pjLfPcqfUn8wjlABntBP2hhGEuG5SFoNU3YKsR8qH34i9R81fLy+ApnhPpxchtrVCdxCFj8IcYu5eePtFrLc/cv/F7UL6NCVbKNlsg2atFSxLrQSqAybaZS56BTM1f72CVqBUBdlPHOoVXNIa5UeJu9JTwDpIJmXXE/72+vJ83qVrVf+uoYgYKG7RyZjKaGM60u04hO6ZiCmtXvR1/FQE4Gb/Nz+WddTYmLzmrpvW6O/nNRyeyCwcGgEISVOIYtwLPyZqmoWbomk7aASGQvn6q34lP4bjaKWi2dHIYmDEGHb2BlvXorByWXIjgxg5zzlj4d5aQZ9/4ffdKyrX361vzvDeqKliq/RCqhq/3yIMortBknn0Ov/AW1c+2gFeSULXTHpc6Qn+Dh5j0CtumXqeYkyWdonr7OANDo1NEpen0w9Hyafq0YrMK0Dyzo9VO8cCnR2vayX1s/magZt7SqDJbAzHvf8N++jMTHLje+fYuLZ1yifG0XYYt6NkObQT70dpy9PMFMlM9Sn5IZhvsNVOl1TWJZa2rrq9skoVpktK6WL12lTESweV/pn21r8eiSREoqHRnBLORACO+uRHRnAsm1G3n4fWBBW6vgzVSoXrne9/2l0QZ2wBZUL16lcvLHi9xrWgymUwZxGrdLLyePJ5OcqyvVSSR5P0ZoYMihjpt0z2rXTbuQ7uXloOybtftFZQDpo2+m9UXK8TgPVKzOPVtxB/6zdUI3kM80mn9FHuYE6af8sF0taaTrn5moGbduVfuXSDU7/7hNYtoWd8VT/2iji3o/+dEfdFjvjcf9/935O/i//H/zZKtgWlhAgHZx8Hn+uotIVBa3AbpQq3ApXsdLvRfd/p+Kz9HNS/dOJ1EQnbIvskHK19B07wNz56wzce3heVdPrLzL8lrvwpyrc8V/+OLm9QwvcOEuxVEGd4VYSo+omdeB1wR8BLXdKOuCq/fUFWqt0gTLOceq9y6VDtqPdQPocK/kf07uJ9FY8Tn1pdLqmHpOXPK4Br6LcVelAdQ01GeiJrdPKbaV/m5vb1H1bGv10umbpjv3zG6Xm1ByvfPKLi9I10/n8u95+LzOvXKR6eYJdb7mLvtv3cfVrz+BPJ8HDBQVavWi914AQYIGwVW9eYdvIKPknSmQZZCzJ7R5AOBal2/dz5y8+Rm73ALk9g3h9BV755BcXBGidUo47/ssfbxVjrUKzaKnG9IZbhXY9LPf3rTNt9Oob1Mpfu0k6vX+1EuTr5TKt08r20RlGevehawP0Y607pMceoHYAOrcf1D3qR8Ur9OddTTrn5jZ135ZGfzXpmp3y+UtH93H5L75P7dokub2DKlCZcZHNZNuVrg7XFavbIF/fHijgZlyye4epnL1KHEaq0btlqTaKtsDKuFgZF2+wyLs+/c/pv/PAgnOkV+dREHL1q09z4XN/Y1QytwyrcS3otMow9bNk+Qljo0nXBwgWSzTr16C1I9C+/+nUMRGtncckandQRE0iq2nGvrlN3belT3816Zp6gkgHDC3bZtdb7qJ6eYwrT/6Q+rWp+apQtcAR8+cXiUF0CitMs5rXnV/tp7r1xHM13EKOYLaKsCycQhanr4BbypPbP0Th0AhuKU/p6F7+zuc+vsjgQ2t1vvdH38i1rz2DQFA8spfi4T0Uj+xFRpJTn/hzIn/rl7NvT1yU8enQ+GYROpAqaQV92/33vUI6iKwnKz1JpauBQ1pFWjpWkXYx6R2BSysj6CirT7PUmVIHUXUBB5Ofb72KZy/+dtbMalL+Ok0QcRQxfeoCuZFBikdGyOzup//OA/QdO4iwHVWYlARzJeD1F7BzmdaEYAm1A2hHV/MK0VsLoQQZxgTVOl5fHsuxiWo+ccNXKZjZDJZjM3DvYd7yb/5v9HUw+Gk6TaawsEGNoRcp0ArELocOnELL/9+DqxlAjStLK68fWmPW7h4dj9ATArQmNj1ZpOMSWRamlK4WnRY6lHzfGHO8Ld07y6X89R07wMSzr9GcLFMfnyGOFvoaG2NKL8bOuBQOjhA3Q9xSHreUB8cmnFPpnP5sFa8/T1jzkUGEcByVyRPFyiUi2oKhsVy4uBBixRLGG0Vzsow3UCBs+Mg4RlgCr0999uZUmdqVcerXp5h49rUlG8gblcytRjpFcYjO+e9p2p/XOfRaAK3X0MZbG/4BVGC2RitoHSevl2j58fV79ff0/6vO3d5au9ZtafSX0tA/+rOP8Nyvf2ZehE2GEdOnzmPZFsXDyqcf1ptEfojXl6fvroPUrk7MywDYjk3uzgPMnb0GAoJynaihtGGkAMu1iaO4lbef9vVbJLINsuXmiXurv64MIsrnrmE5NlJKsCzqY9OEtSb+TAU74/Laf/oq2aHSkv55U2C1lehUHeoCd6IUK9O6Od1IB13bFTN7hRi1KtfB0iFa8g4zqPtQpJXJ0y7mpgu79G4gXcy1ddiWRh86p/z1HTvAc7/+mUUibMKxmTx5hjiKsWwbf6aCAEbecR9OxmPkHfcx9v2XaYzPULs6gT01S1Rt4vUXcQtZcnuHqFwZo3FjhqiWBGaEsvZWxsMp5gjnasg4xsq4EKuiJhDIbtLFt4qVBJzDSN0L11WbXAmN8RnyB3YjhNLPKR7Zu6R4nSmw2iosVR06Q2vlvlxevaa3dq4L0bGHGFV85rW9FrJQ/rnbZ9Gr+xqtYq6tw7Y1+rA45W/i2dc6ZvUUD+9BhhH7H3srud0DuKU85/70G8jEGHv9Rfa+5yEufv67eMN9DL7hdqoXruENlIjqPmG9QWaoD4Ggdm0SYQmE4xDVfSzXxsl5CCRxEOGW8kShUux0CjkaN6ZVG8YNMPwi4ygtnGpzcR6+xhbzf+/CUgHr7O4BqpfHaE6VyQyW5mWRl+pitdRuyxRY9RLp6lC9ko1Qq9xpWvIJK6HXU9h0Ra+u2NWGG5S7R6ehxqgV/FKfRTeXuRs1OW6dPrrb2ui305wsI2PZsTGHcGxyuwc48N7jAOT3D3PqE39O+dwo/kyFxo1pwmqdXcfvJg5CZBLosXMetdFJEOAUsokcgQr0yiBExqppiJSQ2zvInne9gcrlMQ7+vbcx/r2Xufbtk8QTIVLESZCX9f+/sXS2kcC2HfAi4kZnP6SwLBWXQOXku8UMQbWO5TrKjSUl2ZGB1Bu6++dNgVWvE6MqUbVUgk5T1Ktc7cpYKb1s8KH1ubRLJ41OwdQBt+VqBHS2z1VaDVe2Rh/dHWX0oyBk4sSrrfRLVGOOkXfct8jPXDy0h3s/+tM8+/E/xJ+pULl4g6DWYOx7L+EW8wSVGk7Ow854xFGMEBLLdRBAft8wzak5lHBbTFj3VQO2fcME1TqlO/Yx8rZ7Cco1alcnqBZyNMdmEI7S7o+CgGiuUy7xTWKrlo4yDMkM78btz+NPlqlenVCVxBYIx1EKopZF1PBxchmEbSHDmLDWJG4GYFv03XVgvuIWWNY/bwqsehXtx6/RklWAJPDEQvmD9PetzlLxhgBlsFcSmE1nK2kjvzX66O4Yox81fa5+5YdYGQfb87Bzyp8X1ptc+9ZJ9v7IGxb4maOmzyuf/CLeYIm5c9fI7hqAyVmEbRE2fYRlMXfhOv133YaV6NIIKyle8lyyI4NYrkN9bIbYDxC2Rfn1q8yevoyT82jcmCYOIurXJvH68jgZh/q1aYJq/eYzehLjvohABYvtfIY9736AqefPElYbSp4iakCcyCpYFsKycEt5LNsif2AXQaVO6fb91K6OE/uRug8Jxj+/FegkHAbKOOkMnbTcgnbtpP8GezUwu96kNYFcWrueNOmteFrzH7ZKH93enY7WmelTFwjn6ux75CGwwJ+p4M9WiZsBsR9w4LG3LnA76DxzGUREdR9vqIhI+rMSxWRGBiCKqV4eU921bIs4CNn7Y29Uq/cL12lOlRM5A6VRY2c94jDEn64w9r2XKdymagCIpHI17Rkkv3eI7N4h3IEiIufNuxmF53TeadsWWOr6HQ1+Iq3gDhXZ+2MPMnniNYJqA2+oj+zIgCoqS84rEFiuTVRrEMdKRC4zWGLX8bvY9Za7sPMeUa1pBNC2DA06C4dN0fJnaz93mq2VgrgyVuqm0uqdDq3uXWnSxWcWrd68aXr7/q1Xj9zHgN9BObo+LaX8zbbXHwGeQLWaB/i8lPI31uPaK0XnjXv9RfY/+paF3ZgazUWNuvXxYb05X4xVOLCL6tUJooZPVGvg9hUoHhrh2H/1k3iDJa58+Smuf+sk3kABGUtiP0QiVbC34ZMf7iOs1LHzWYJqgxvffoF973mI8adPK1eLhOxwnzr/XB0n4xI0A5AS6YfKN59U/8ogRHgOTj7L0Z99hPHvv8LkyTNYlkUsY4gklpto3VsWd/7DR7n8fz5FY7qM9MN52eg4VmmZVjKpxGGE5TnIICKs1Bm8/yi1y+N4g0Xe87mPE5Srxj+/JVgqK0fLJusVvr/o3S3N+u0iGb6a3bMWYMvQknHW9yit1zNM53Vzb/9PrNnoCyFs4JPAe1FLiaeFEF+SUr7cduh3pJQ/tdbr3SzpvPFF3ZguXF/kl9bHO7nM/PvsrEfp6F7q16fpO3YAYVk8+H//h4y87T6ipk9jYpbJE6+T2dVHbt8wUb3JxInXVNBUSoK5WmsMjq3qAZoB+x99C6Nff4YoCBl+6Bg3vvsi2BZ2xiGsNJA6lz+WSepwjNtX4PDP/AjXv/U89etT5A8MM/v6ZbxSnjgIicOI3J5BhGPTGJvh+ndfImj6qtG4a2O51ry2jpVxsFyXwYduJzvUrxrCz1Q4/MFHKOwbNgZ+S7KcZnsz+eqWihmizMN28+mvlCoqp99GiatFtArXsqjUzvbdw9boo7seK/2HgTNSynMAQog/A94HtBv9TaU9bzwOIxrjM9RvzOAUPPqOHeh4fBSE881A7JxH1AzIDJUoHdmH5dkMv+nYvErn9MsXaUyViZo+zckypTv2E4fhwiIlXaUqpYoP1JtYtk129wBIVHxAvzZXx/Icoli2MnsEYFscev+7ye0eYOD+I8TNgGC2BnFMUG1gZ11Kt+8D1IQWVBvEUYSwbNX0xBIqYzNxB7mFHHEYkR3qZ+gNt6v3XbxBYd/wfDaTYauxlIuhk5pkJ7R/302dz6alormdSUtM+MAuVHqmnkR1IHzjBdPWynqM7gDq02uuJM+18w4hxEkhxFeEEPd3O5kQ4iNCiBNCiBPj4+PrMDxFujHH9EvnufiF73DtG89Sfv0ysR/y3K9/hsqlG4uOt12HwsHdBJUatSvjhJU6hYO7sTyb+3/1AyBlS8b5yF7cQhZvoIiUkrkzV3FymZZxLeYQjk3Y8BGujZ31cHIZmlNzFA/vUbuIsWkVZE5aNqrgsIPI2GBbOMUcxYMj8/r9biHLG/7lh7j9Hz1K8eg+3EIWO5chqDaYOzsKCLJDfXh9RTJDJSzXQUpw8hmcYk5V3iZBXDubKlYxVbNbnKV2ZRGdfdHt6KBljHJ36Mye7Y6e6HTLRx3gTRdzbZ5g2lpZj5V+pwhJ+zLgWeCwlLIihHgc+CJwrNPJpJSfAj4FcPz48XVdThQP7eFNv/ELfO+f/Fv67jpIbmRwvstTp+rSdJ55/cY0zek5MgPFBc1A0gVfcRTN7wqcXAZ/psLgA0e4NjZN7IcQSbxSnub0HE7WQ4aRiivkMzzwqx8E4MTHPk1UaWDnPPxyVYWUchmiehNpSYq3jSBs5RrS2TOZ4X4mT7xG3Aywcx4yloRzdZxijsyufuK6komwXBu3lCOsNpBhjHBbqZe5kQHcoso3Nlk524GlNNsFrZ6w7f78tGaI9l3rHcEgLbfGdl7pp/P09eMaqrlMP60irE59dHuf9TD6V1B7Gs1B1N2ZR0pZTj1+Ugjxu0KIXVLKiXW4/qoov34V23Pov+vOBc93qy5dLs88LSymWwSOPfUy/kyFoNqgOTXHwb/3dvzpOcJExG2olAckBx9/GwP3Hl7gL3/n7/8zvvdLn6A6OontuTjFPDKKiBp+InksCOZq+DMVssN93PPfvI/Tn/wiQlgc+LvHGXvqZaK6T7PhE5RrZHcNsPc9DzHx9GlkGGNlPOxYkhkqISwbb6CI7TnIMCaq+1QuXDdVs9uCpTTb96H+bbW+DLRyzrWUsIPSoamiJg1d0NSrKpprRUtNQGe3Vx2VATWFugf7UP59ff86pcZ22hWt9Lhbx3oY/aeBY0KIo6jytA8BP58+QAixF7ghpZRCiIdRn3Jy0Zk2gPVWf0wHiOMoIqw1Kd2+XxnpcpU7f+EnOPqBHwNYUWWqVypw/N/817z42/+Za2MzxA0fy3PIDJY4+BNvpT42Sxz4vOF/+BDDbzrG9EvnF0hL6Myk6pVxpl44x+Abbyc71Dc/GXmlPLVKnbDu4/XlGbzvCLl9wxx47K0ICc3ZCt5AkcbELLk9g11VNA29TowyLIO0grJpnZhRWo3B242cngB0YFKv7LWfe7tk9KRJ24ROuxiBMtZZ1OfXqa+HktfbBes6Ved2Erbb+CreNRt9KWUohPgV4C9R0+UfSClPCSF+KXn994APAL8shAhRU+aHpFxF37x1ZL3VH3XAt3LxOjOnLxElrpSooQK/Iw/fO2/cV1qZWjy0h4f/119m9OvP8Np/epLYj8gMlgjKNfL7BhcoW7ZPYjozKTsyQOXCdZoTZYoHd8+nqpbPXKXvrgMcfv+PkE3aHA4+cJT69an5lpGmy9VWZynjopUj08a8XVDNRRmhtLRwkDpmO7p3dJbEUiJr+hgPdW994FLqmPbU2HR17lIptBtbxSs2yfauiOPHj8sTJ06s6zmjps+Jj/3vyEguUn8UtuioGLkcs69f4a8/+BsqHTKReLCzHgP3HsYbKNzUOefH6wdL7hAmnn2NV/7dFxaJyAFKMtpzsF13SUN+K+6JYb1ZjfvgLK2qUo325d+RnEe7d6ZpGXTdRzaTfIEybi5qV9BgYS/Z7YLFwiB1p8+m4yC6Y1ZAq/mKDXRaLDZQ3u4SKhZyhc4r+vRxa0cI8YyUsmva3Y6RYdDcCvXHYK7G0P1HsfOZ+YIvHSDupkK54vEuE1NYSsK4cHA3b/rX/5jya1eWdCutpqewYTNYjVtgufx8PXHo53YDZVSg0qW1utcSBE1amjRNWlLLaR/4Vkcb9FzyNU0rgBvR2uHo5uhNWlIVOgaSp7M5Ddq+d2Pjqnh3nNGH9Vd/bE6WEc7Cgq95bnGXqOUmMa+YZ9eb7yJq+kyfusD1vzmpPm+q65XpctXLrNYt0M14aBfNJC0ZZWgJhvm00hP14mEWZSIGk+N81MSxWvXNXsaiFetIZzWR/NyuxpnWKMqlnptFBXbb74vb9r0bG7eT3pFGH9ZX/XGzu0QtN4np4rFu/vrNHr9hKVayci+1Pd9OiDJKuqiqRsuY5Wjl4Gvt/AwtF4eWI2iw0O3Ru27hlWOj7msRdd8OoHJRMih3jF7Zt6N9/w1aUg3ax6/dYu3VuUul0G5sFe+ONfrryeD9R3BKOWZOX8ZyrXmd/qBc27B8926TWNT054vH0u6bdF2C6XLVy6zWLdBuXPQqNE5+LtEKSM4l79Gr/RotN47O7OlPzqFTFdtbCG41BMow63aHughLu8oOoCTCcrTcWbo4TWcupVf7+eR8U6hJQL/WXp27VArtxlbxGqO/DtRvqB6y0y+eJWoGCCGwXIeRd9zHQx//R5saBF2pv950uepVVusWaDcuWj7ZRRlw7X7QLp4hWsYvh0quC1Cr1imUidCr3m7ZLVvFv5+nFajeh/rM2rWjJ7OrtIK1WnET1D1pN8x64sygJtP0vewUaNdVvFs/T39Ho1fSbiHH4ff/yLx6ZxyE2En/3M1kpf560+WqV7kZt0DauEyiDFeR1gSg/dY6/TD9N1pI3qdXtDVUoLd9dZ9W4dwsg7+aXUcetVKPUJ9pHDXJpVfZ2pWmV+46UykdyE2jJ4RpVLvFEZY34JtfxWuM/hppX0m3q3dudubLavz1pstVL3KzboG0camgDFPaQOqq2ypqRatNwRQt4xaj+r92OvdWcvHoVbt2Tzm0gtbpYLh2lfm0ahk8Wn10O6FTYdPVub2NMfprpNczX4y/fjuwFrdAjpbR0v/uAcqNA60G4DpF0UGtWvUKXusz6dVuJxfHZgV10/o4S40hHYB2aK3g24PheieVXtGHdHZf6V0Syeu6z3DvG/7eH2GP0+uZL2l10cqF66br1ZZFr9yHku8r/deto1wbuhlIJXlOu2Z8lLHTcgwxMEYrd1/797Xxj1NfAuU22uz0zdVMOtp4p+VF9Apfu9LSgdqlKnRDWlk7U6iiuPbe1jHK7z+VfF9uh7Ta41ePWemvka2wkl5Pf73O958/Tyrf39CLBCiDPQhM0DLeOs1QoFb72thpA6jdPzrNU1eephuCD9FS3dTVvL1MWkMojf4/0K60S7R2VUt1D9PBbQ81+YUsdBetVmtnY7R5jNFfI7eiwvdWsB7++uXy/Q2bwXLyDPrvT/uetXFPF2dpzXxt0B0WN0hPuy70yl732NUqnL1u9DU+arfjsjgYngXuRK20L9FyjaVTNdvR9yXtLiqwuqK6jdPm2XHaO7eK5TRytjpGn6cXWcnKUGvx1JPj9co+3RgkLb1AcoydnEsHNaElxdweA7BptV7sVfS4dVzCQUlQHKL7KjoEXkAZfv0Z0/ZS1zdYKO0dXcS2BzUBrEZrZ/20eYz2zgax3TNfjD5Pr7HSlaF2WZxl8epdr+i1f95h4QQSpI7T33UgtJY6v44J1Fm4i+gl9GfUnzOHMvoBLd2h9l2Sg5oUzqTeb7edS2cBpV1A6faS3Wh/feO0eYzRN6yIXs9S2nmsRp4hi+rv+irKyBdRBjqkVXXq0DLeaUG1dBZPWmJAX0t3lYKFHad6FT3pOaiVddoE2rRSL/UkMJR8VWlNGBat7CeblnxFunaiusw42nfFG6fNY4y+YUX0epbSzmO1K0MHtfrX7iBdrKR9/Hla7pt0MZZW3kzvArSkg14EaFdRL67w0+hdiG6IUqKlMxSgahKmUK4abeBvQ632L7GwmbxOXtDpoFp9VNdOrLaobuO0eYzRN6yIrZCltLO4mZVhp3z/GNVFK71jGKKlqLkHNQnoSl69UtbFXjebrqlX080VHKuzgwQL3U83i57sPJSR13LJGoly/2hX2VFafvqZ1Nj1scMoo5x2D622qG7jtHmM0TesiK2SpbRzuNmVYbsMgHbtpM+jjWwBZewGae0QQhZq8WgXkDbKK/Xpeyx0IS2lZqnHvZzB71Sk1f6cvo6Dmsz0Mem00zLK6LuoCfJVWkZXN04ZYrGhb2e1RXUbo81jjL5hxRh9nl5ivVaGKzmPNkZzwEXUpOGhVvtpl086SJw+PyyeDHS3rrRypz42Tr0HWiv89syZ9mvpoGo6i6jbBNRMPpee8NLnBbXT8Wj1xc2wcHKb49Zo7dx6bZ51MfpCiMeA30Hd9U9LKX+z7XWRvP44KurzC1LKZ9fj2oaNZbtnKW0t1mtluJLzpDN1tCtoF3CNVg1AJ3RgWBeCpYu40juDdP/ZdD9efZz+npZeSKeP6h1DegHSnlWjPwe0Gsfrc6bHoSch7cNv0MpM0r7+LIt7GWwN1mz0hRA28Engvahw+NNCiC9JKV9OHfaTwLHk623Af0y+GwyGNbFeK8NObp85Fk4C7cFhC6XTM0F3t05aktlioRaQNuwOLdnjtL9dyz+kg6c6V769wMyh1dCkP7lGu1CaDlRrQ69VN/XnjWl1w7KSa+lj0pNamNyLJjvS6AMPA2eklOcAhBB/BrwPSBv99wF/LFUl2FNCiAEhxD4p5bV1uL7BYFhXuhV9DXY4No9a9dY7vKbR59Epn/nkSxtOXQiWNuRa5167ayp0d9vEqXPrCUQb7wqLdxQZFqZg6tW9Dl57LNQYSmcq6Wtrmeqtx3pECA6g/kI0V5LnVnsMAEKIjwghTgghToyPj6/D8AwGw8ppL/rSX7p7ls1iH3iOlvtHo5Us064Z/bg/eU8JZch9Wg3YdSaNFnyrp57vhk4n1St5fb0irYphXWegs3J0ADuiJSqnaxX2oOIZwyxtItcjk2jjWQ+j38mZ1ymEvtwx6kkpPyWlPC6lPL579+41D85gMKwGXfTVqXgootX8u5H60gZWG1W9eoaWT7+AWoEP0XIw6Gvplb5uzAILs2zSIm/tpFfxHmqC0pNShtYOQE86WhVTTwJ6V6CLrvpQk5JWMtVjTa/89bg2W1305lgP984V1LSoOYhK/F3tMQaDYdNZzmVh0TnX/yItmQcdVE0HPg8k70nnw6cDwOnAbVraWLt9BMpA60ridIaPdsHsRsUY0plI+eS7dtHoY7VvH1o7Ae2/1xNeidZuRb83reGz9fz5sD5G/2ngmBDiKKrB5IeAn2875kvAryT+/rcBs8afbzD0Iisp+uoU9M3SWvlDK31SSzJXgNtZ6K65wEID3q5kqbtdpX3vOmAbp95bolWb0CkTKd37t4ZqFF9nYZMYfX1Bq8ahhFr5z9GaePT4+tixRl9KGQohfgX4S9Qd/AMp5SkhxC8lr/8e8CQqXfMM6q7/47Ve12Aw3ApupujLQkkVpI2+NqAZVAA4RBnaUvLaq7R2FZ26UunJQqB867oXgE6nTMcLdNaOHlunjCb9s0ur+KpMSzdHTy77WFhVexQlwdCgNUlkk8+7NXtQrUuevpTySZRhTz/3e6nHEvjoelzLYDDcSm626CsL7GdhloyHMsjal66N/BxqtZ0OpKbRGv1aH6iB8rNrQ69jATqWoMe8EiOsdx164tC7iyxqIhjq8Lnu5FZXyW4kpiLXYDC0cbNFXxlawdRO6J2DdpfoVXNa3lnn87u0fOwxyvDqClmdP69dPdp9000iWROjPNCl5DzaR68zho51ed+tr5LdSIzRNxgMHbgZQ3ezrqEcrSygGLWqz9Ly2x+mNZGU2sbVAM6zshaDaTlqra6ZNvy93ARm/di6exSDwdBjaDdLp5TOtPtFp0NqI6uzZ/Q5dKqlbnbSbfJZqqbgMotz+9vrC/QuQbugtmax1WoxK32DwbCOrMQ1lM6K0St07V/XKZoNlo8jtDeSkbRW71oNtD91/MY1KulljNE3GAzrzHKuoW5ZMRlaVbAriSOkV+YhKjisV/cRqnbgLlqTwsY1KulljNE3GAybwHpkxaQbmcwmj9MmzaJzv+Bb36iklzFG32AwbBJrzYrRK/caLdcQtCqDc6hJZRTl5ulWvLW1UzBXizH6BoNhi6JX7q+zMPNGF2pN06r+nWNhVs/2ScFcLTtnejMYDNsQXR2rWxf2oSqAqyysBVgqq2dnYYy+wWDY4pRo9bTN0Frda518LzlOF3xVN2GMvYMx+gaDYYvTXh+gxdRA+fLbJZB3Rj5+N4xP32AwbAPSAdpZVMOXIp0173dGPn43jNE3GAzbBJ0NVKClu79z8/G7Ydw7BoNhm7FSOYidiVnpGwyGbYjJx++GMfoGg2Gbsr0kkdcLM+0ZDAbDDsIYfYPBYNhBrMm9I4QYAv4zcATV5fhnpZTTHY67gKqDjoBQSnl8Ldc1GAwGw82x1pX+x4BvSCmPAd9Ifu7Ge6SUDxmDb9hOBEHEhbOTvPTcKBfOThIEO6P7kmHrstZA7vuAR5LHfwR8C/iXazynwbAlmByv8tUnXqZa9ee7uxYKHo+97z6Gd+/sXHBD77LWlf4eKeU1gOT7SJfjJPBXQohnhBAfWeqEQoiPCCFOCCFOjI+Pr3F4BsOtIQgivvrEy0gp2T1SZNdIkd0jRaSUfPWJlwnNit/Qoyy70hdCfB3Y2+GlX1vFdd4lpRwVQowAXxNCnJZSfrvTgVLKTwGfAjh+/LhcxTUMhg3j6qUZqlWf3SPFBc8XihnGxypcuTTDkTuGN2l0BkN3ljX6UspHu70mhLghhNgnpbwmhNgHjHU5x2jyfUwI8QXgYaCj0TcYtgKVcrOjqguous/KXHMjh2MwrJi1une+BHw4efxh4In2A4QQBSFEST8G/i7w0hqvazBsKsW+DN22oRIoljIbORyDYcWs1ej/JvBeIcTrwHuTnxFC7BdCPJkcswf4rhDiJPBD4MtSyq+u8boGw6Zy4NAAhYJHtbJwRV+tNCkUPA4eGticgRkMy7Cm7B0p5STw4x2eHwUeTx6fAx5cy3UMhl7DdW0ee999fPWJlxkfqyzK3nFce7OHaDB0xGjvGHYsQRBx9dIMlXKTYl+GA4cGcFdhrId3F/jgh9/MlUszVOaaFEsZDh4aMAbf0NMYo2/YkaxXjr3j2iZLx7ClMNo7hh2HybE37GSM0TfsOHSOfaG4MMOmUMxQrfpcuTSzOQNbR4w8hKEbxr1j2HFsZo59tzjCWuMLaYw8hGEpjNE37Dg2K8e+mzF+27uP8IPvXlgXI93uutJUK02++sTLfPDDbzaB5h2Oce8YdhybkWPfLY4QRhF/9Ps/IIridYkv7ATXlWFtGKNv2HHoHHshBONjFSbGKirXXohblmPfzRjHkaReD4jCeMHzN2ukjTyEYTmMe8ewI0nn2M9M16lVfQp5l7lyg76B7E3707vRzRj7TbWS9331PYpj5mYb+M2IWtVnZrq+5HnbYwHZvGvkIQxLYoy+YcfiuDalvix/+9fnbsqfvtLgaxBElMsNpqfqOK5FqT+LbalNtpdRx3ueTa3mc+b0+HymTaMR8v2/Oc9thwc7jqVTjCCXdbAsoVxVqV2FkYcwaIzRN+xYVhv0TBv5KIp54Zmr1BvhkpOFNsxzc02mJ6tMTVTI5T3uvGc3+byHZQtyORcsOHNa9Y/IFzx8P6TkZikUva5j6TZ2ACkx8hCGjhijb9ixrEYTP72qllJy/swkjmNx130jREGM34yYnanz5Odf4ud+8ThOkoapDfOevSVKpQxnXp2gXvN58blRjt4xTLGU4cP/5G187cuvMDfXJJt1CIIY17W58+5d5AteR33+pcZeqwW848eO4jiWkYcwLMIYfcOOZaVBz/ZV9cx0DcexQMLTf3uJvoEsQqh3hWHESyev8dDxg4sMc77gce8bR7h+tcz4jSoj+4rc94a9NOoBt9+1i1otoFjM4Hk2ff1ZLNvqOJarl2Z48blRqnNNhobz2La1aOyNesADD+1f93tm2PoYo2/Ysaw0X7/dePvNCCmVIY7iGNsWZHMuAOWZkL/52hkeeHDfokkl7bOvVn3+5mtn+MF3L3LgtgGCIGL8RoW9+/vI572OY0nvNqpzTa5emaU825zfEWjiWFKebfDSc6NrLvQybD+M0TfsWNL5+ksFPduNt5exCfyIOJLYlliQbum4NnEUc+XSzIJJJYrjeZ99Lu8yPVmjfyCHl7WZmqhx7wMjTE1UeeWF67zp4YNYSaBXj2XPvhKf/9OT87uNoV15yrMNAj/kzKsTPPDgXizbYmJcuYIkYFtiRYHp9awGNvQ+xugbdiwr1cRv3xGU+rMIC+I4xrIEtqMMdOBHuK5NoehRmWty9/175ieVIIgIgoh8wWOu3ACgUPQQlqBWDahWfO59YC8vPj/KpfPTFEuZBWO5cW1uwW7DtizuvGc3Z06PMzfX4NKFafIFjyuXZjh0dJBdu1dWjWskG3YexugbdjTtmvjaTXPtyixz5QYHDg0s2hHYlsWR24d54dmrAERRTK3qq+DrPbupVnyKpczCSeVGlUYjBARxrCcOvX+Q+H7EwFCeo3cMc+fdu9izv29BAPbaldlF8Yd83uOBh/Zx6fw0x+7ZzdDuAhIWGHzo3qzdSDbsTIzRN+x4tCb+UqtebbyvjZaZnqjSqAdksw77bxugrz+Ll1HB13otWOAa0pPKD793ke988ywjI0XiJPunhcDzlHEVluCOu3dz4NAAVy/NcPqlG0sWXVmWRaGU4YE37adSbmJbnUPTnapxV5O9ZNg+rMnoCyH+AfCvgHuBh6WUJ7oc9xjwO4ANfFpK+Ztrua7BsN6kV71Du/LzVbHTUzX+7DPP8O5HjnLgtn5OPnOVRiPEEmBZgovnpjhy5zAF6TF6+QZxLHn43Ufwg2h+ley4Nm9952HOvz6JlBIv4xDHktnpOiJJvJkYr3J9tEzfQA7XsfjcHz3bsehqbrZOFEn8ZoSXsbFtMT/JXLk0QxxLZqZr86/rQrBO1bhGsmFnstaV/kvA+4Hf73aAEMIGPolqnH4FeFoI8SUp5ctrvLbBsG60tHE8Tj1/jSCICEMliRCFMTPTda5cnMYSgl17ijQbIUEQ4TgWVy5MY9kQx+A4Nl/78mm++82zfPifvI0779kNqPjBo4/fzWf/8BkunJskiiSNmk8YSQQwOV7DEpArePy///U3OXR0kNsOD2LbFlEUM3Z9jqmJKpMTNaIoxhICx7XI5T0+/E/ehuPa5HIuVy7NEPjh/ITjujb7b+vvWI27WWqjhs1lTYJrUspXpJSvLnPYw8AZKeU5KaUP/BnwvrVc12BYbyrlJlJKXnt5jLlyk1rVZ3a6jmULLMdi9NIMURgTxZJL56cYH6swM11nLpFXqFUD+vqzDA7lGBrOI2PJH/3+D2jUfEAFTP/qL05z7eoscSyRUoIQWBZYtkDKGISgVlHXff30OKeeH2Vyosqpk9e5eH6ac2cmqZQb+M2QKI6JY8ngUI7vf/s89ZrP1598lUNHB8nlM5Cs4eu1gEvnp3n08bsX+ec3Q23UsPlshE//AHA59fMV4G3dDhZCfAT4CMChQ4du7cgMBlraOBfOTnHj2hxCSGSs8t1FYpjjWK2J40QgzXEEwhL4fghAvRYyNVHDsgX5vEu9EVCvhvzJH5zgbT9yhG88+Rpzcw3m5poIBI26Txjqdbb6HhDOj6le8xm9WubCuSnyJY+wqVJELSFoNiN8P8LzbM6+NsHY9Qoj+0rz/vmhIZXOqY9p+hH1erDoc680e8mwvVjW6Ashvg7s7fDSr0kpn1jBNTq5DbvtKpFSfgr4FMDx48e7HmcwdGM1eec3Rst8/rMnmZyocv3qLHEMti3m/2rjWBLHkMlY+H4rHz8IIywhFvwlR1FMvR4xO91AW9DvfOMsT33nAvm8R6MR4PsRliWQy/xlxxE06moSqMz6qc/WGoNPhGXFuPWAH3znPIViBhlL5csfaIm6TYxVuvrn27OXjGTD9mdZoy+lfHSN17gC3Jb6+SAwusZzGgwdWU3e+fXRMp/87W8T+BHNZjBviKNosUWOJQghEreMOrFELjDejUZInLzXsoRamdtKmmGuXAcEMpaEHc5/M0ShxHIFtZpPPCaZnKxRLHoEfoQQgiN3DLN7T3GBf77bhLiSLB1TxLU92Aj3ztPAMSHEUeAq8CHg5zfguoYdxkryziUqaDszVePrT57Gbwb0D+aZGIuwbEEUdjbIYRgzMJhjerKeGHylZGlZouX6SRlz/Vj3v1XnXf+NaxTHxNLCdgSWJZierBEnl3rx+VGGhnIcuXMXBw8NrKkQyxRxbR/WFMgVQvyMEOIK8A7gy0KIv0ye3y+EeBJAShkCvwL8JfAK8Dkp5am1DdtgWMxyrQJPnbzG5/7oWf7qL07z13/5OpcuzFKZ81UlracE1ES3/4jEwNuOIJO1cVxwPQvHUT7/bgRB2HUiWRekwHUtpJTUKj7NZkjgq+rfZj2gnriIurVrXElbxrW819B7rDV75wtSyoNSyoyUco+U8ieS50ellI+njntSSnmXlPIOKeX/Y62DNhg6sVTeuZSSb33t9XnDlS94ZLMOSJiarFEoeCBAxl1OIFQmzF337kEIgVLUjPGDGBDYXbwcUdj5+fWi2KeE1uq1EGFb9PXnKCSfzXZswjBidrrOie9fuuneuabv7vbCVOQatg3d8s6jOGZirEIQxBRKGZrNkMpcE4nEcW3CoHN2SxoZQ60acPql63hZm+FdBcpJMxWkJI5QWT8bnHrgOjZ+MyKbd4hDiRBqtxI0YsIgolqRnD87SbXiMzCYY2ZKFW7ZnoUAwiBeti2jKeLaXhijb9g2dFLNrNV8Xnnhump+gmT8+hwAxb4stYrKioliycRYdUXXkBL8RkS9FjA4mKNSaVKd8xEWOK5F4HfbKqw/2azD8O4C/YNZZqcbxETKzVMNCIJI+d6lxG+GTE5UGL0yy/DuAlGkis5AaQCFYbxkW0ZTxLW9WJN7x2DoJXTeuRCC8bEKYzfmePG5URBw5z27CJqqghZgrtyg1J8hlpKgGQKqMlZ0W9KmkBLKs01Gr5SZKzeJIkkYyA01+JmsjevZ+EFELKFabRKGsTL4vq4lsBEoieVmI8RvhmpXUwtwXBvHtajONSkWM/NtGdP++SCIuHB2kpmpGlEYMze7cDdgiri2Jmalb9hWpPPOz7w6TrXic/jIIDMzdeIYajXlxomiiGY9RMqYOCb5kjiOIIpW7qbpGgO4RejSgDCIsURMpdwkm3WxHRvHFkk7R3Wsnxh/27YIIzXQyYkqtmPhuTZa8XPPvhKlvuwCkbX2bJ0winn91QlG9pbIZh1TxLWFMUbfsGXpljeuVTMr5SbnS5NIoVIOgyAijmKEUEZeECMliZFUljIMJZbFhvvmV4p2IUkp8f2QTGjTbKpMopnJRiuTKDX+IIywbYsYSSbrEIWSUn8Wx1G6PlaizKn9891SX/v7M1QrPg+/6zD9gzlTxLVFMUbfsCVZSd54sS9Doxly8sRVblwrJ0VLLYNuOxYItWpO2/h4g1fvq0G7kNQYJTNTjQWvdxp7FEpkHGE7FoWCx8xMg8BPXF2yJeus/fPdJJdLfTkajYj+wZyRXN7CGJ++oafRfuWXnhvlwtnJ+Q5UT37hFLMzdWQscVyLoV35RXnjI/tK3LhaZmpcuTSEWOizj6KYOLGSK3Dlb2niOGn2UguIgojybIPJsSrl2QaOay/wz5tsne2NWekbepZuq/lDRwc59cK1+aAssKBr1ZVLMxw4NMDzT18BobJzpEy7chRSgoxaj7c7QgjqNdXhSwqVymo7gudPXOGNb9rPT33gDTiu3TFbJ4pVxs/0VF315g0iI8GwRTFG39CTdPMrl8t1nvjcC9iORb7gtY73I86cHmffgT5GL8/ynW+c5dyZCSYnqsRxTJg0L9cr/Z1g5NN4noVlC4QQZLIO+byX7HQgDCMqlZaoW3vqa63mc+b0OPWajxCCF54d5fzrk0aCYYti3DuGnqRbFWgcSYIwXpQ143pK42ZurskP//Yir566QXXOJw4lYRArcTKLRS6enUIQxMhY6fN4rkMm5zAwlGdoV55iKUOYTLJhsoLXqa9j11Xaa70WkMtneOCh/ezZWzISDFsYY/QNPUk3v7Kf5Nqntew1YaDSMK+NzuJ6Nv2DWbK51mY2jlXrQstS0slLaeZsN4QQCCHJFzMIS+B5Czf5fQPZBZIKOvX1DW/ez+BwnrvvG+GBB/fO766MBMPWZQf92Ru2Et2qQL2M8iPv3p2nXguZmapTrTSpVQMQgv239RNFEtezEUIwOFxQ+vgJfjMijuWKNO23C5YlyOYdQBA0QyUulxD4amXf159dFKR1XJu+vixDQ3kGhvJY9kJzYYK6WxPj0zf0JJ0kFQB8P6RZD5kYr+I4FoGvqmH3HsgzNJQnk3XwmyGNeoBlWUxP1XBce0EDFC/j0GiEC5WOdaR4GyKSuoNM1mZ4d5FyuYEQyoevA+BWl+bpRoJh+2FW+oaepF1SYWKswo3rc1y5OMs99+8hl/cQQuBlbISQjF2v0PQjrlyexW+GTIxVuXp5hjiKyWSdeT++ZUOz3eDD9jP4AlzXoq8/QybjkM+53HZkiHe953YKBRcZS3aNFLn3DXvI572ukgqmj+72Q8ge3uMeP35cnjhxYrOHYdhEwiCab+VXnm3w4rOjjOwtEccx5dkGjXpIsxly4ewkB27r59DtQ7z07DUmJyo0GiGWZeG5Fo1mNN/rNt3spIf//NeMl7EpljL4jRAva5PJuEiUS6eWGPFSf45DRwcZGs53zcYxDVS2FkKIZ6SUx7u9btw7hp7GSbXye+m50XnJAMuy8DIOl85PU6341Ko+10fnqFUDDt8xRNMPicI6sZQIS5DN2vQP5JidadBsBkpfp4crb9eKsCAKY2rVJlEcg1CCcNmcy8BQjkJRrd59P0AA/8XPP0g273U8l+mju70wRt+wZUj7l6M45szpcUC5gmzbolBURuvqpRmO3bOb118ZI4okA0M5mrVQvVeotM8VG3wdA95iO4Js1sHzbLyMQ3m2SbMREcch9VrA5HiVbM7BcSzCMOb82UlefXmMB48f7Ho+Z4V9dA29j/HpG7YMaf/ynK4K9WxiGWNZFpmMM5+vb1liPr0wm3GJpSSMIhr1EClVXv9K2Yp5/X4zpOmrZjH5goPjWti2aqsIkkYjxHEsHMcijmK+9bXXTc79DmGtPXL/gRDilBAiFkJ09SEJIS4IIV4UQjwvhDBOesNNsSC4e6NKoxFSqwZkMg5Dw3mCsGW0qnN+8rrP9etlGo2Amck6caIqGcfxyoy53Hj55PUgilSzF78Zkcm4SYqqRML8YyW9LHA9hyiSJud+h7BW985LwPuB31/Bse+RUk6s8XqGHY72L//wexf5zjfPMjJSpFD0mJyoceHsFLVKQBTFXDw/RS7v8s5HjhIGMX4zYmK8wrWrZXw/RCBoxh2yeLYRjmsRBjGTE1VyeRfZUJ219GwXBjFuRlAouBQKnsm53yGsyehLKV8BkkbRBsPG4Lg2b33nYc6/PqnaIb40RhBEOK6gUY+IwpiRfSV27Skydm0OEAwM5dizv4/pyRqlvixhEDExVlnW5qelmLcaYRATS5BBjOtaZLIOtZo/3yQmiiV9WZeRfSXA5NzvFDYqkCuBvxJCSOD3pZSf6nagEOIjwEcADh06tEHDM2w1XNfm0cfv5j/89rcJ/BDHVRW4ff1ZbMfi0vlprlycnjfYliUYHMohhMXAQI4rl2ewbEEcL23RvaxNsxHN7whsRyBj2dOa+xo9RglUyj63HR3g2tU5mo2AOJL0D2bwsjYXz03heg65Ltk7hu3FskZfCPF1YG+Hl35NSvnECq/zLinlqBBiBPiaEOK0lPLbnQ5MJoRPgcrTX+H5DTuQej3g4KEBvIyN34zwMja5vMuJ71+iUQ/I5l1yOQchBFEUMzvTJJO1ERZkMjZIj/Jsd5eGZUMUyAUuoHgVrRRvNfO7kCWqifUxzWbE5FiNbMbBb4QMDuXI5TxAkMu77L+tj69/+TQf/PCbTSrmNmdZoy+lfHStF5FSjibfx4QQXwAeBjoafYNhpVTKTSxLMDCYVz/PNTnx1GVmpuvK0NUDZCTJ5h1s2yIIQqS0eeBN+3n1pRs0GgF+c4owiuaNedqg65TGtFHtFYMPqbEsYfD12G1HcPBIP8fu2cPlizMU8i6+H+F5SnfHsq0FPXIN25db7t4RQhQAS0o5lzz+u8Bv3OrrGrYn6b645XJj3j1TmWvyw+9dxG+GxJFsNRCPYqoVn2zWRQCDw3kynk2hlGFgSBVr1as+gR8RRnGS7eKQzamMljgOcBwVs4pjJdO8VUiyM3Fc1Qt3bla1QBy7NsfAUH7R8UZAbWewJqMvhPgZ4N8Du4EvCyGel1L+hBBiP/BpKeXjwB7gC0mw1wH+VEr51TWO27ADaZcDiGLJ1STN8OL5KaWzk3EIgwghBI4rQAps16JQ8rBtS70violCpS6ZzTgIIMxEhGHMwKCN41jUagEyiJGxRNgWcRwTRVvH4GuEUpFWOvoZm5PPXEF00ZQ2Amo7g7Vm73wB+EKH50eBx5PH54AH13Idg6FbJy3bFklXp4A4lghLYtkWQsRIKZBxjBULgiCiUm4SRTHnz0wRhpLXXhnDb4RUK01iKbGEwOl3OHrnLg7dPsQ3v/IqfqCaqQd+bxr85bKLpFQNVGxHZTBZlkUcy0XqpUZAbedgZBgMWwLdSStt8AF27S4yOV7F85rUagGFokccS26MzhEEkUpNjEICP2J4d4E3vukA+YJqFXhjtIztCN745gOEUax6x0pJNufywIP7+MaTrxKGEXEPF6ouMvhtQV3t5vI8m/HrVfYd6OPBtxzg/JlJxscqiwTUTBB3+2OMvmFL0K2TFkAmoxqEOK5DHMfMlRvkCi5Z6dKoBXgZG9ezKRY9sln1Jz832wAh8DIOuYI7HwwGGLs+x5f+vy9yx93DlGfr1Gthlyu3IZRxtSxBo77C96wXifVuT+SxbNUisX8wTxjGVKs++2/r5+F3HTYCajsUY/QNW4KlmnnkCh7ZXIzj5jn/+iR+U+nKxLFatd9x1y4mxisEoaQ822BgKI/fjNDmUT1uUav6+EHEwdsGKBS9eb2eNEqmWT3OZJXgWzbnUq/7EIPjCMJwA1N9UtlFlq3GZgnV1jCOYwSS6lyDQtFlz76SEVDbwRjBNcOWYKlmHqVShvf/3EPk8x59A1m8rIOXcegfyPHwuw/TP5hNjtZ6M7rtokg9bhEEMY5tcebVCbyMQ7GUwfUsROq/JV30lct5DO8u4Lo2lmVh2QJhWVjJaXXB+s0Urguh4hbzTWCsZNipBu+i7b84jtQh2ZxLGCiRudmZBvVagLAsPv+nJ5kcr65+MIZtgTH6hi1Bp05aY9fnmCs3OHrnMPV6wPt//kF+9NE7OXBwgAce2sdb3n4bxWKGUn8W17UJgxgvUdcs9WdRamrQ15+dv0610qTU580HO7XESDanpIptR+C4Sp3Sy1j0D6jm645tEcsYIcH1HAoFDy+jNtJSKmNtO9aCfr3L4TgC17PVJJKMQ0qwrYUB3LQgnOOpScdKJgohBINDeQaGcuw70Mexu3YhpeSrT7xsVDV3KMa9Y9gypJt5jF6e5eQzVxGWxamT13jp5DUKBY9HH7+b869PIqXESlITbcti/239XDo/TdNvae5o98bkRG1BQPM9P3EXn/7336NSbuJ6KrjrNyNsx8ITAsuxGBzM8e4fv4NCMcOp50epVQNmZlTTFoCh3XlqFZ8b9TmkhFiCSBqyA0RRF9dPyikfRhIRRwsDs5bAdiycxOgHfjRv/G1btUjEEeQKDoEfz7udXNfmzrt3YdkWhWLGFGLtYIzRN2wpHNfmwKEB/vavz1HqyyxKO/z6k6/y6ON38/UnX12UnfIr/+JHqdeDBcFLYEFAc8++Ep//05McODTAmdMTgMCylDGNJRRKGcIoZmhXgcsXZigUPN7/82/ixeeuEoYxszN1PM/GdW0yWYd80aNe9bEsQaHokcm6eBmbsWsVJDLR8ZEIIbBtQRRJhAWu6yQGXSKFavqiXEkuti1oNiNkKq3IdgS7R4qqH7AlsJLPHUUxt985PF91qzGFWDsXY/QNW45u6Zt6BVuvB6tq75de7V44O0m16nPb4UHK03UazVBp94QR01N14jhmcCDHkTuGsCxLTTRfPs3bf+QI516f5ODhAc6cHqdW9ZGy5Vu/49gwpf5c4iKyGN5dnC8si2PVBMYSIGyL6lxTBa6lpFEPERYEjZAwkvT1Z5krN7BsAVjYMkZK2DVSpH8wN/85atWAbE7FNTpV35pCrJ2LMfqGLcdS6Zt6BXuz2Sn63LZtcec9I5x+6QZTkzXCUOX616oBxVKWRj0kk3MIgojxG1VGr8ySy7nIWPLAQ/sozzbwmxFDw3luXJsjjKSaCPAoZRz+4S8e56/+4jRz5Qa2beF5No16yMULU/T1Z6nMNZXuT0Icw94D/Ry9fYhGIyAIImpzPpOTNWpVH8deGJ4Lw4hiMc/w7qIpxDIswBh9w5ZjqfTNTivYtF5PsS/DgUMDuF1W/elzZ7IOjiPoG8jgNx0qssnI3hK2Izh96ga2LQjDmEYj5HvfPs/wrgIAtZpqNu4HETPTdQ4eGiCKYoIgJhvHPPr43ezZ38fjP3P/vKxEGMbUGwFSSlzPYWhXASklUSSxbUGjHtCsB9iOxd79/QDMTNWYmWkwtKuAbVvUqv6Cz/Ken7iLg4cH+eoTL5tCLMM8xugbthzp9M3lVrDtej1poze8u7DkuQM/Igglpb4slXKThqtcJgDj12fpH8hR7MsAgpGRYhL0hXf+2FHm5pp8/2/Oc+ye3ZT6FmYHff3JV/ngh9+8IDBdmWuSzTn85ZdOc/nCNH0DrfcEfkShmGFwOE+1otpAau0h17M5dHSQoeH8/O4iimJKfVnuf3AfjmuvytVl2P4Yo2/Ycuj0zeVWsEEQ8eQXTs27UNyMTak/S6MW8NUnXu6oHZ8+99hYhUYjACRexmZoV4EwUMJrKvgKvh/iugvliW3HYmAwh+1YCww+sChzpt0NNfbWCpcvTi9YtbuuzZ337KZW8Xn4XYfpH8zNG/BczuXrT746n4EkLEF/KbfgPphCLEMaY/QNW5L2VXKnFezLJ69x6oVrOE7L360NaLXid01ZTPfh/e43z7F7T4G+/iyNRpgEaYN5d42XcedTISGVFSNZNu7Qif239XP0juEFjWH6+rNJ0NinfzC3aMxmJW9YDcboG7YsS61ggyDiW197HYB8odUGMPAjzpweZ9+BviVTFtN9eHXOfz7v8cBD+zj3+iRhFHP3fSMMDOYWpEKmYwqriTtoDhwaoFhSmTtpPaClgq9mJW9YDaYi17AtuXpphiiSOE6b+8azCYKIasVfNmWxUxXw5ESNvfv7eODBfWSyzgKDnzbMS8lGLJU50+ma42MVhBAm+GpYF8xK37AtqZSVcZ2bbeL7IZ7X+lMPgwjLtlaUstjNjTQ701g2prCSuMNqrmkMvmE9MEbfsC0p9mUQluDOu3dx5tUJalUVkNVKZT/23jtxXHtF6Zyd3CcrMcxrMd7GZWO4VRijb9iWaPeKlJIHHtyr0hn9VjrjAw/uW3U6ZzsrMczGeBt6jTX59IUQvy2EOC2EeEEI8QUhxECX4x4TQrwqhDgjhPjYWq5pMKyEtG98crJGGMYqnXEgx+M/cz8SFrRf3DVSZPdIcVUKlEEQceHsJC89N8qFs5MERrXSsAVY60r/a8D/KKUMhRC/BfyPwL9MHyCEsIFPAu8FrgBPCyG+JKV8eY3XNhiWZCn3itbY6abfs5wC5Vp3Cbea1VQhG3YWa22M/lepH58CPtDhsIeBM0mDdIQQfwa8DzBG33DL6eZeWYl+Tze6NWmvVppdi742kl6fkAyby3qmbP4i8JUOzx8ALqd+vpI81xEhxEeEECeEECfGx8fXcXgGQ4vV6vek0SqfaQkIULuEalUVfW0W7RPSzbitDNubZY2+EOLrQoiXOny9L3XMrwEh8CedTtHhua7NQ6WUn5JSHpdSHt+9e/dKPoPBsGpuNo8e1rZLuNX08oRk6A2Wde9IKR9d6nUhxIeBnwJ+XMr29tGAWtnflvr5IDC6mkEaDOvNSvV7OrGWXcKtppcnJENvsCafvhDiMVTg9seklLUuhz0NHBNCHAWuAh8Cfn4t1zUY1oObzaNfjcrnRtPLE5KhN1irT/8/ACXga0KI54UQvwcghNgvhHgSQEoZAr8C/CXwCvA5KeWpNV7XYFgXdKD3gYf2z6teLkcvSyWsxW1l2BmIzh6Z3uD48ePyxIkTmz0Mg6EjYRD1pFSCyd7Z2QghnpFSHu/2uqnINRhukl6ttjXaPYalMEbfYNiG9OqEZNh8jLSywWAw7CCM0TcYDIYdhDH6BoPBsIMwRt9gMBh2ED2dsimEGAcurvDwXcDELRzOWujlsUFvj6+Xxwa9Pb5eHhv09vh6eWyw9PgOSym7atj0tNFfDUKIE0vlpm4mvTw26O3x9fLYoLfH18tjg94eXy+PDdY2PuPeMRgMhh2EMfoGg8Gwg9hORv9Tmz2AJejlsUFvj6+Xxwa9Pb5eHhv09vh6eWywhvFtG5++wWAwGJZnO630DQaDwbAMxugbDAbDDmLLGn0hxG8LIU4LIV4QQnxBCDHQ5bjHhBCvCiHOCCE+tkFj+wdCiFNCiFgI0TWtSghxQQjxYtKLYMM0pFcxvs24d0NCiK8JIV5Pvg92OW7D7t1y90Eo/l3y+gtCiDffyvHcxPgeEULMJvfqeSHEr2/g2P5ACDEmhHipy+ubfe+WG99m3rvbhBB/LYR4Jfl//acdjln9/ZNSbskv4O8CTvL4t4Df6nCMDZwFbgc84CRw3waM7V7gbuBbwPEljrsA7NqEe7fs+Dbx3v2/gI8ljz/W6fe6kfduJfcBeBz4Cqoj4duBH2zg73Il43sE+IuN/jtLrv2jwJuBl7q8vmn3boXj28x7tw94c/K4BLy2Hn97W3alL6X8K6m6cgE8heq9287DwBkp5TkppQ/8GfC+Dset99hekVK+equvc7OscHybcu+Sa/xR8viPgJ/egGsuxUruw/uAP5aKp4ABIcS+HhrfpiGl/DYwtcQhm3nvVjK+TUNKeU1K+WzyeA7VefBA22Grvn9b1ui38Yuo2a6dA8Dl1M9XWHzTNhMJ/JUQ4hkhxEc2ezBtbNa92yOlvAbqjx4Y6XLcRt27ldyHzfw7W+m13yGEOCmE+IoQ4v6NGdqK6PX/UeiBeyeEOAK8CfhB20urvn893URFCPF1YG+Hl35NSvlEcsyvASHwJ51O0eG5dclRXcnYVsC7pJSjQogRVJ/h08nKoxfGtyn3bhWnuWX3ro2V3Idbdq9WwEqu/SxKj6UihHgc+CJw7FYPbIVs5r1bCZt+74QQReD/B/wzKWW5/eUOb1ny/vW00ZdSPrrU60KIDwM/Bfy4TBxcbVwBbkv9fBAY3YixrfAco8n3MSHEF1Bb9XUxXOswvk25d0KIG0KIfVLKa8k2dazLOW7ZvWtjJffhlt2rFbDstdOGQkr5pBDid4UQu6SUvSAotpn3blk2+94JIVyUwf8TKeXnOxyy6vu3Zd07QojHgH8J/H0pZa3LYU8Dx4QQR4UQHvAh4EsbNcalEEIUhBAl/RgVmO6YQbBJbNa9+xLw4eTxh4FFu5INvncruQ9fAv5RkknxdmBWu6g2gGXHJ4TYK4QQyeOHUf/3kxs0vuXYzHu3LJt575Lr/ifgFSnl/9blsNXfv82ISq/HF3AG5ct6Pvn6veT5/cCTbdHt11AZDr+2QWP7GdQM3ARuAH/ZPjZUtsXJ5OvURo1tpePbxHs3DHwDeD35PrTZ967TfQB+Cfil5LEAPpm8/iJLZGxt0vh+JblPJ1FJD+/cwLF9FrgGBMnf3H/VY/duufFt5r17N8pV80LKzj2+1vtnZBgMBoNhB7Fl3TsGg8FgWD3G6BsMBsMOwhh9g8Fg2EEYo28wGAw7CGP0DQaDYQdhjL7BYDDsIIzRNxgMhh3E/x/TMd2Mut9LbQAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Plot the points with colors\n",
    "for k, col in zip(unique_labels, colors):\n",
    "    if k == -1:\n",
    "        # Black used for noise.\n",
    "        col = 'k'\n",
    "\n",
    "    class_member_mask = (labels == k)\n",
    "\n",
    "    # Plot the datapoints that are clustered\n",
    "    xy = X[class_member_mask & core_samples_mask]\n",
    "    plt.scatter(xy[:, 0], xy[:, 1],s=50, c=[col], marker=u'o', alpha=0.5)\n",
    "\n",
    "    # Plot the outliers\n",
    "    xy = X[class_member_mask & ~core_samples_mask]\n",
    "    plt.scatter(xy[:, 0], xy[:, 1],s=50, c=[col], marker=u'o', alpha=0.5)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Practice\n",
    "\n",
    "To better underestand differences between partitional and density-based clusteitng, try to cluster the above dataset into 3 clusters using k-Means.  \n",
    "Notice: do not generate data again, use the same dataset as above.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "# write your code here\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Double-click **here** for the solution.\n",
    "\n",
    "<!-- Your answer is below:\n",
    "\n",
    "\n",
    "from sklearn.cluster import KMeans \n",
    "k = 3\n",
    "k_means3 = KMeans(init = \"k-means++\", n_clusters = k, n_init = 12)\n",
    "k_means3.fit(X)\n",
    "fig = plt.figure(figsize=(6, 4))\n",
    "ax = fig.add_subplot(1, 1, 1)\n",
    "for k, col in zip(range(k), colors):\n",
    "    my_members = (k_means3.labels_ == k)\n",
    "    plt.scatter(X[my_members, 0], X[my_members, 1],  c=col, marker=u'o', alpha=0.5)\n",
    "plt.show()\n",
    "\n",
    "\n",
    "-->\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h1 align=center> Weather Station Clustering using DBSCAN & scikit-learn </h1>\n",
    "<hr>\n",
    "\n",
    "DBSCAN is specially very good for tasks like class identification on a spatial context. The wonderful attribute of DBSCAN algorithm is that it can find out any arbitrary shape cluster without getting affected by noise. For example, this following example cluster the location of weather stations in Canada.\n",
    "&lt;Click 1>\n",
    "DBSCAN can be used here, for instance, to find the group of stations which show the same weather condition. As you can see, it not only finds different arbitrary shaped clusters, can find the denser part of data-centered samples by ignoring less-dense areas or noises.\n",
    "\n",
    "let's start playing with the data. We will be working according to the following workflow: </font>\n",
    "\n",
    "1.  Loading data\n",
    "\n",
    "-   Overview data\n",
    "-   Data cleaning\n",
    "-   Data selection\n",
    "-   Clusteing\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### About the dataset\n",
    "\n",
    "<h4 align = \"center\">\n",
    "Environment Canada    \n",
    "Monthly Values for July - 2015\t\n",
    "</h4>\n",
    "<html>\n",
    "<head>\n",
    "<style>\n",
    "table {\n",
    "    font-family: arial, sans-serif;\n",
    "    border-collapse: collapse;\n",
    "    width: 100%;\n",
    "}\n",
    "\n",
    "td, th {\n",
    "    border: 1px solid #dddddd;\n",
    "    text-align: left;\n",
    "    padding: 8px;\n",
    "}\n",
    "\n",
    "tr:nth-child(even) {\n",
    "    background-color: #dddddd;\n",
    "}\n",
    "</style>\n",
    "\n",
    "</head>\n",
    "<body>\n",
    "\n",
    "<table>\n",
    "  <tr>\n",
    "    <th>Name in the table</th>\n",
    "    <th>Meaning</th>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td><font color = \"green\"><strong>Stn_Name</font></td>\n",
    "    <td><font color = \"green\"><strong>Station Name</font</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td><font color = \"green\"><strong>Lat</font></td>\n",
    "    <td><font color = \"green\"><strong>Latitude (North+, degrees)</font></td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td><font color = \"green\"><strong>Long</font></td>\n",
    "    <td><font color = \"green\"><strong>Longitude (West - , degrees)</font></td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>Prov</td>\n",
    "    <td>Province</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>Tm</td>\n",
    "    <td>Mean Temperature (°C)</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>DwTm</td>\n",
    "    <td>Days without Valid Mean Temperature</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>D</td>\n",
    "    <td>Mean Temperature difference from Normal (1981-2010) (°C)</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td><font color = \"black\">Tx</font></td>\n",
    "    <td><font color = \"black\">Highest Monthly Maximum Temperature (°C)</font></td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>DwTx</td>\n",
    "    <td>Days without Valid Maximum Temperature</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td><font color = \"black\">Tn</font></td>\n",
    "    <td><font color = \"black\">Lowest Monthly Minimum Temperature (°C)</font></td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>DwTn</td>\n",
    "    <td>Days without Valid Minimum Temperature</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>S</td>\n",
    "    <td>Snowfall (cm)</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>DwS</td>\n",
    "    <td>Days without Valid Snowfall</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>S%N</td>\n",
    "    <td>Percent of Normal (1981-2010) Snowfall</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td><font color = \"green\"><strong>P</font></td>\n",
    "    <td><font color = \"green\"><strong>Total Precipitation (mm)</font></td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>DwP</td>\n",
    "    <td>Days without Valid Precipitation</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>P%N</td>\n",
    "    <td>Percent of Normal (1981-2010) Precipitation</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>S_G</td>\n",
    "    <td>Snow on the ground at the end of the month (cm)</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>Pd</td>\n",
    "    <td>Number of days with Precipitation 1.0 mm or more</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>BS</td>\n",
    "    <td>Bright Sunshine (hours)</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>DwBS</td>\n",
    "    <td>Days without Valid Bright Sunshine</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>BS%</td>\n",
    "    <td>Percent of Normal (1981-2010) Bright Sunshine</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>HDD</td>\n",
    "    <td>Degree Days below 18 °C</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>CDD</td>\n",
    "    <td>Degree Days above 18 °C</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>Stn_No</td>\n",
    "    <td>Climate station identifier (first 3 digits indicate   drainage basin, last 4 characters are for sorting alphabetically).</td>\n",
    "  </tr>\n",
    "  <tr>\n",
    "    <td>NA</td>\n",
    "    <td>Not Available</td>\n",
    "  </tr>\n",
    "\n",
    "</table>\n",
    "\n",
    "</body>\n",
    "</html>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 1-Download data\n",
    "\n",
    "To download the data, we will use **`!wget`**. To download the data, we will use `!wget` to download it from IBM Object Storage.  \n",
    "**Did you know?** When it comes to Machine Learning, you will likely be working with large datasets. As a business, where can you host your data? IBM is offering a unique opportunity for businesses, with 10 Tb of IBM Cloud Object Storage: [Sign up now for free](https://cocl.us/ML0101EN-IBM-Offer-CC)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "--2020-09-10 06:27:27--  https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-ML0101EN-Coursera/labs/Data_files/weather-stations20140101-20141231.csv\n",
      "Resolving cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud (cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud)... 67.228.254.196\n",
      "Connecting to cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud (cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud)|67.228.254.196|:443... connected.\n",
      "HTTP request sent, awaiting response... 200 OK\n",
      "Length: 129821 (127K) [text/csv]\n",
      "Saving to: ‘weather-stations20140101-20141231.csv’\n",
      "\n",
      "weather-stations201 100%[===================>] 126.78K  --.-KB/s    in 0.07s   \n",
      "\n",
      "2020-09-10 06:27:27 (1.66 MB/s) - ‘weather-stations20140101-20141231.csv’ saved [129821/129821]\n",
      "\n"
     ]
    }
   ],
   "source": [
    "!wget -O weather-stations20140101-20141231.csv https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-ML0101EN-Coursera/labs/Data_files/weather-stations20140101-20141231.csv"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 2- Load the dataset\n",
    "\n",
    "We will import the .csv then we creates the columns for year, month and day.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Stn_Name</th>\n",
       "      <th>Lat</th>\n",
       "      <th>Long</th>\n",
       "      <th>Prov</th>\n",
       "      <th>Tm</th>\n",
       "      <th>DwTm</th>\n",
       "      <th>D</th>\n",
       "      <th>Tx</th>\n",
       "      <th>DwTx</th>\n",
       "      <th>Tn</th>\n",
       "      <th>...</th>\n",
       "      <th>DwP</th>\n",
       "      <th>P%N</th>\n",
       "      <th>S_G</th>\n",
       "      <th>Pd</th>\n",
       "      <th>BS</th>\n",
       "      <th>DwBS</th>\n",
       "      <th>BS%</th>\n",
       "      <th>HDD</th>\n",
       "      <th>CDD</th>\n",
       "      <th>Stn_No</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>CHEMAINUS</td>\n",
       "      <td>48.935</td>\n",
       "      <td>-123.742</td>\n",
       "      <td>BC</td>\n",
       "      <td>8.2</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>13.5</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>12.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>273.3</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1011500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>COWICHAN LAKE FORESTRY</td>\n",
       "      <td>48.824</td>\n",
       "      <td>-124.133</td>\n",
       "      <td>BC</td>\n",
       "      <td>7.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>3.0</td>\n",
       "      <td>15.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-3.0</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>104.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>12.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>307.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1012040</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>LAKE COWICHAN</td>\n",
       "      <td>48.829</td>\n",
       "      <td>-124.052</td>\n",
       "      <td>BC</td>\n",
       "      <td>6.8</td>\n",
       "      <td>13.0</td>\n",
       "      <td>2.8</td>\n",
       "      <td>16.0</td>\n",
       "      <td>9.0</td>\n",
       "      <td>-2.5</td>\n",
       "      <td>...</td>\n",
       "      <td>9.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>11.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>168.1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1012055</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>DISCOVERY ISLAND</td>\n",
       "      <td>48.425</td>\n",
       "      <td>-123.226</td>\n",
       "      <td>BC</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>12.5</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1012475</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>DUNCAN KELVIN CREEK</td>\n",
       "      <td>48.735</td>\n",
       "      <td>-123.728</td>\n",
       "      <td>BC</td>\n",
       "      <td>7.7</td>\n",
       "      <td>2.0</td>\n",
       "      <td>3.4</td>\n",
       "      <td>14.5</td>\n",
       "      <td>2.0</td>\n",
       "      <td>-1.0</td>\n",
       "      <td>...</td>\n",
       "      <td>2.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>11.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>267.7</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1012573</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 25 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                 Stn_Name     Lat     Long Prov   Tm  DwTm    D    Tx  DwTx  \\\n",
       "0               CHEMAINUS  48.935 -123.742   BC  8.2   0.0  NaN  13.5   0.0   \n",
       "1  COWICHAN LAKE FORESTRY  48.824 -124.133   BC  7.0   0.0  3.0  15.0   0.0   \n",
       "2           LAKE COWICHAN  48.829 -124.052   BC  6.8  13.0  2.8  16.0   9.0   \n",
       "3        DISCOVERY ISLAND  48.425 -123.226   BC  NaN   NaN  NaN  12.5   0.0   \n",
       "4     DUNCAN KELVIN CREEK  48.735 -123.728   BC  7.7   2.0  3.4  14.5   2.0   \n",
       "\n",
       "    Tn  ...  DwP    P%N  S_G    Pd  BS  DwBS  BS%    HDD  CDD   Stn_No  \n",
       "0  1.0  ...  0.0    NaN  0.0  12.0 NaN   NaN  NaN  273.3  0.0  1011500  \n",
       "1 -3.0  ...  0.0  104.0  0.0  12.0 NaN   NaN  NaN  307.0  0.0  1012040  \n",
       "2 -2.5  ...  9.0    NaN  NaN  11.0 NaN   NaN  NaN  168.1  0.0  1012055  \n",
       "3  NaN  ...  NaN    NaN  NaN   NaN NaN   NaN  NaN    NaN  NaN  1012475  \n",
       "4 -1.0  ...  2.0    NaN  NaN  11.0 NaN   NaN  NaN  267.7  0.0  1012573  \n",
       "\n",
       "[5 rows x 25 columns]"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import csv\n",
    "import pandas as pd\n",
    "import numpy as np\n",
    "\n",
    "filename='weather-stations20140101-20141231.csv'\n",
    "\n",
    "#Read csv\n",
    "pdf = pd.read_csv(filename)\n",
    "pdf.head(5)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 3-Cleaning\n",
    "\n",
    "Lets remove rows that dont have any value in the **Tm** field.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Stn_Name</th>\n",
       "      <th>Lat</th>\n",
       "      <th>Long</th>\n",
       "      <th>Prov</th>\n",
       "      <th>Tm</th>\n",
       "      <th>DwTm</th>\n",
       "      <th>D</th>\n",
       "      <th>Tx</th>\n",
       "      <th>DwTx</th>\n",
       "      <th>Tn</th>\n",
       "      <th>...</th>\n",
       "      <th>DwP</th>\n",
       "      <th>P%N</th>\n",
       "      <th>S_G</th>\n",
       "      <th>Pd</th>\n",
       "      <th>BS</th>\n",
       "      <th>DwBS</th>\n",
       "      <th>BS%</th>\n",
       "      <th>HDD</th>\n",
       "      <th>CDD</th>\n",
       "      <th>Stn_No</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>CHEMAINUS</td>\n",
       "      <td>48.935</td>\n",
       "      <td>-123.742</td>\n",
       "      <td>BC</td>\n",
       "      <td>8.2</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>13.5</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>12.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>273.3</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1011500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>COWICHAN LAKE FORESTRY</td>\n",
       "      <td>48.824</td>\n",
       "      <td>-124.133</td>\n",
       "      <td>BC</td>\n",
       "      <td>7.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>3.0</td>\n",
       "      <td>15.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>-3.0</td>\n",
       "      <td>...</td>\n",
       "      <td>0.0</td>\n",
       "      <td>104.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>12.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>307.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1012040</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>LAKE COWICHAN</td>\n",
       "      <td>48.829</td>\n",
       "      <td>-124.052</td>\n",
       "      <td>BC</td>\n",
       "      <td>6.8</td>\n",
       "      <td>13.0</td>\n",
       "      <td>2.8</td>\n",
       "      <td>16.0</td>\n",
       "      <td>9.0</td>\n",
       "      <td>-2.5</td>\n",
       "      <td>...</td>\n",
       "      <td>9.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>11.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>168.1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1012055</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>DUNCAN KELVIN CREEK</td>\n",
       "      <td>48.735</td>\n",
       "      <td>-123.728</td>\n",
       "      <td>BC</td>\n",
       "      <td>7.7</td>\n",
       "      <td>2.0</td>\n",
       "      <td>3.4</td>\n",
       "      <td>14.5</td>\n",
       "      <td>2.0</td>\n",
       "      <td>-1.0</td>\n",
       "      <td>...</td>\n",
       "      <td>2.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>11.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>267.7</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1012573</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>ESQUIMALT HARBOUR</td>\n",
       "      <td>48.432</td>\n",
       "      <td>-123.439</td>\n",
       "      <td>BC</td>\n",
       "      <td>8.8</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>13.1</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.9</td>\n",
       "      <td>...</td>\n",
       "      <td>8.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>12.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>258.6</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1012710</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 25 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                 Stn_Name     Lat     Long Prov   Tm  DwTm    D    Tx  DwTx  \\\n",
       "0               CHEMAINUS  48.935 -123.742   BC  8.2   0.0  NaN  13.5   0.0   \n",
       "1  COWICHAN LAKE FORESTRY  48.824 -124.133   BC  7.0   0.0  3.0  15.0   0.0   \n",
       "2           LAKE COWICHAN  48.829 -124.052   BC  6.8  13.0  2.8  16.0   9.0   \n",
       "3     DUNCAN KELVIN CREEK  48.735 -123.728   BC  7.7   2.0  3.4  14.5   2.0   \n",
       "4       ESQUIMALT HARBOUR  48.432 -123.439   BC  8.8   0.0  NaN  13.1   0.0   \n",
       "\n",
       "    Tn  ...  DwP    P%N  S_G    Pd  BS  DwBS  BS%    HDD  CDD   Stn_No  \n",
       "0  1.0  ...  0.0    NaN  0.0  12.0 NaN   NaN  NaN  273.3  0.0  1011500  \n",
       "1 -3.0  ...  0.0  104.0  0.0  12.0 NaN   NaN  NaN  307.0  0.0  1012040  \n",
       "2 -2.5  ...  9.0    NaN  NaN  11.0 NaN   NaN  NaN  168.1  0.0  1012055  \n",
       "3 -1.0  ...  2.0    NaN  NaN  11.0 NaN   NaN  NaN  267.7  0.0  1012573  \n",
       "4  1.9  ...  8.0    NaN  NaN  12.0 NaN   NaN  NaN  258.6  0.0  1012710  \n",
       "\n",
       "[5 rows x 25 columns]"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "pdf = pdf[pd.notnull(pdf[\"Tm\"])]\n",
    "pdf = pdf.reset_index(drop=True)\n",
    "pdf.head(5)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 4-Visualization\n",
    "\n",
    "Visualization of stations on map using basemap package. The matplotlib basemap toolkit is a library for plotting 2D data on maps in Python. Basemap does not do any plotting on it’s own, but provides the facilities to transform coordinates to a map projections. \n",
    "\n",
    "Please notice that the size of each data points represents the average of maximum temperature for each station in a year. \n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "ename": "ImportError",
     "evalue": "cannot import name 'dedent'",
     "output_type": "error",
     "traceback": [
      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[0;31mImportError\u001b[0m                               Traceback (most recent call last)",
      "\u001b[0;32m<ipython-input-14-6b98a7110c83>\u001b[0m in \u001b[0;36m<module>\u001b[0;34m\u001b[0m\n\u001b[0;32m----> 1\u001b[0;31m \u001b[0;32mfrom\u001b[0m \u001b[0mmpl_toolkits\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mbasemap\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mBasemap\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m      2\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mmatplotlib\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mpyplot\u001b[0m \u001b[0;32mas\u001b[0m \u001b[0mplt\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      3\u001b[0m \u001b[0;32mfrom\u001b[0m \u001b[0mpylab\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mrcParams\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      4\u001b[0m \u001b[0mget_ipython\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mrun_line_magic\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m'matplotlib'\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m'inline'\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      5\u001b[0m \u001b[0mrcParams\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m'figure.figsize'\u001b[0m\u001b[0;34m]\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0;34m(\u001b[0m\u001b[0;36m14\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m10\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
      "\u001b[0;32m~/conda/envs/python/lib/python3.6/site-packages/mpl_toolkits/basemap/__init__.py\u001b[0m in \u001b[0;36m<module>\u001b[0;34m\u001b[0m\n\u001b[1;32m     24\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     25\u001b[0m \u001b[0;32mfrom\u001b[0m \u001b[0mmatplotlib\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0m__version__\u001b[0m \u001b[0;32mas\u001b[0m \u001b[0m_matplotlib_version\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 26\u001b[0;31m \u001b[0;32mfrom\u001b[0m \u001b[0mmatplotlib\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mcbook\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mdedent\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m     27\u001b[0m \u001b[0;31m# check to make sure matplotlib is not too old.\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     28\u001b[0m \u001b[0m_matplotlib_version\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mLooseVersion\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0m_matplotlib_version\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
      "\u001b[0;31mImportError\u001b[0m: cannot import name 'dedent'"
     ]
    }
   ],
   "source": [
    "from mpl_toolkits.basemap import Basemap\n",
    "import matplotlib.pyplot as plt\n",
    "from pylab import rcParams\n",
    "%matplotlib inline\n",
    "rcParams['figure.figsize'] = (14,10)\n",
    "\n",
    "llon=-140\n",
    "ulon=-50\n",
    "llat=40\n",
    "ulat=65\n",
    "\n",
    "pdf = pdf[(pdf['Long'] > llon) & (pdf['Long'] < ulon) & (pdf['Lat'] > llat) &(pdf['Lat'] < ulat)]\n",
    "\n",
    "my_map = Basemap(projection='merc',\n",
    "            resolution = 'l', area_thresh = 1000.0,\n",
    "            llcrnrlon=llon, llcrnrlat=llat, #min longitude (llcrnrlon) and latitude (llcrnrlat)\n",
    "            urcrnrlon=ulon, urcrnrlat=ulat) #max longitude (urcrnrlon) and latitude (urcrnrlat)\n",
    "\n",
    "my_map.drawcoastlines()\n",
    "my_map.drawcountries()\n",
    "# my_map.drawmapboundary()\n",
    "my_map.fillcontinents(color = 'white', alpha = 0.3)\n",
    "my_map.shadedrelief()\n",
    "\n",
    "# To collect data based on stations        \n",
    "\n",
    "xs,ys = my_map(np.asarray(pdf.Long), np.asarray(pdf.Lat))\n",
    "pdf['xm']= xs.tolist()\n",
    "pdf['ym'] =ys.tolist()\n",
    "\n",
    "#Visualization1\n",
    "for index,row in pdf.iterrows():\n",
    "#   x,y = my_map(row.Long, row.Lat)\n",
    "   my_map.plot(row.xm, row.ym,markerfacecolor =([1,0,0]),  marker='o', markersize= 5, alpha = 0.75)\n",
    "#plt.text(x,y,stn)\n",
    "plt.show()\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 5- Clustering of stations based on their location i.e. Lat & Lon\n",
    "\n",
    "**DBSCAN** form sklearn library can runs DBSCAN clustering from vector array or distance matrix. In our case, we pass it the Numpy array Clus_dataSet to find core samples of high density and expands clusters from them. \n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "ename": "KeyError",
     "evalue": "\"None of [Index(['xm', 'ym'], dtype='object')] are in the [columns]\"",
     "output_type": "error",
     "traceback": [
      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[0;31mKeyError\u001b[0m                                  Traceback (most recent call last)",
      "\u001b[0;32m<ipython-input-15-6300e51d4d85>\u001b[0m in \u001b[0;36m<module>\u001b[0;34m\u001b[0m\n\u001b[1;32m      3\u001b[0m \u001b[0;32mfrom\u001b[0m \u001b[0msklearn\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mpreprocessing\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mStandardScaler\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      4\u001b[0m \u001b[0msklearn\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mutils\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mcheck_random_state\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;36m1000\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m----> 5\u001b[0;31m \u001b[0mClus_dataSet\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mpdf\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m'xm'\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m'ym'\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m      6\u001b[0m \u001b[0mClus_dataSet\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mnp\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mnan_to_num\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mClus_dataSet\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      7\u001b[0m \u001b[0mClus_dataSet\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mStandardScaler\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mfit_transform\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mClus_dataSet\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
      "\u001b[0;32m~/conda/envs/python/lib/python3.6/site-packages/pandas/core/frame.py\u001b[0m in \u001b[0;36m__getitem__\u001b[0;34m(self, key)\u001b[0m\n\u001b[1;32m   2804\u001b[0m             \u001b[0;32mif\u001b[0m \u001b[0mis_iterator\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   2805\u001b[0m                 \u001b[0mkey\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mlist\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m-> 2806\u001b[0;31m             \u001b[0mindexer\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mloc\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_get_listlike_indexer\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0maxis\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0;36m1\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mraise_missing\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0;32mTrue\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;36m1\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m   2807\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   2808\u001b[0m         \u001b[0;31m# take() does not accept boolean indexers\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
      "\u001b[0;32m~/conda/envs/python/lib/python3.6/site-packages/pandas/core/indexing.py\u001b[0m in \u001b[0;36m_get_listlike_indexer\u001b[0;34m(self, key, axis, raise_missing)\u001b[0m\n\u001b[1;32m   1551\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   1552\u001b[0m         self._validate_read_indexer(\n\u001b[0;32m-> 1553\u001b[0;31m             \u001b[0mkeyarr\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mindexer\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mo\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_get_axis_number\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0maxis\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mraise_missing\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mraise_missing\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m   1554\u001b[0m         )\n\u001b[1;32m   1555\u001b[0m         \u001b[0;32mreturn\u001b[0m \u001b[0mkeyarr\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mindexer\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
      "\u001b[0;32m~/conda/envs/python/lib/python3.6/site-packages/pandas/core/indexing.py\u001b[0m in \u001b[0;36m_validate_read_indexer\u001b[0;34m(self, key, indexer, axis, raise_missing)\u001b[0m\n\u001b[1;32m   1638\u001b[0m             \u001b[0;32mif\u001b[0m \u001b[0mmissing\u001b[0m \u001b[0;34m==\u001b[0m \u001b[0mlen\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mindexer\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   1639\u001b[0m                 \u001b[0maxis_name\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mobj\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_get_axis_name\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0maxis\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m-> 1640\u001b[0;31m                 \u001b[0;32mraise\u001b[0m \u001b[0mKeyError\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34mf\"None of [{key}] are in the [{axis_name}]\"\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m   1641\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   1642\u001b[0m             \u001b[0;31m# We (temporarily) allow for some missing keys with .loc, except in\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
      "\u001b[0;31mKeyError\u001b[0m: \"None of [Index(['xm', 'ym'], dtype='object')] are in the [columns]\""
     ]
    }
   ],
   "source": [
    "from sklearn.cluster import DBSCAN\n",
    "import sklearn.utils\n",
    "from sklearn.preprocessing import StandardScaler\n",
    "sklearn.utils.check_random_state(1000)\n",
    "Clus_dataSet = pdf[['xm','ym']]\n",
    "Clus_dataSet = np.nan_to_num(Clus_dataSet)\n",
    "Clus_dataSet = StandardScaler().fit_transform(Clus_dataSet)\n",
    "\n",
    "# Compute DBSCAN\n",
    "db = DBSCAN(eps=0.15, min_samples=10).fit(Clus_dataSet)\n",
    "core_samples_mask = np.zeros_like(db.labels_, dtype=bool)\n",
    "core_samples_mask[db.core_sample_indices_] = True\n",
    "labels = db.labels_\n",
    "pdf[\"Clus_Db\"]=labels\n",
    "\n",
    "realClusterNum=len(set(labels)) - (1 if -1 in labels else 0)\n",
    "clusterNum = len(set(labels)) \n",
    "\n",
    "\n",
    "# A sample of clusters\n",
    "pdf[[\"Stn_Name\",\"Tx\",\"Tm\",\"Clus_Db\"]].head(5)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As you can see for outliers, the cluster label is -1\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{0, 1, 2}"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "set(labels)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 6- Visualization of clusters based on location\n",
    "\n",
    "Now, we can visualize the clusters using basemap:\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "ename": "ImportError",
     "evalue": "cannot import name 'dedent'",
     "output_type": "error",
     "traceback": [
      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[0;31mImportError\u001b[0m                               Traceback (most recent call last)",
      "\u001b[0;32m<ipython-input-17-814b2feba22e>\u001b[0m in \u001b[0;36m<module>\u001b[0;34m\u001b[0m\n\u001b[0;32m----> 1\u001b[0;31m \u001b[0;32mfrom\u001b[0m \u001b[0mmpl_toolkits\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mbasemap\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mBasemap\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m      2\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mmatplotlib\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mpyplot\u001b[0m \u001b[0;32mas\u001b[0m \u001b[0mplt\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      3\u001b[0m \u001b[0;32mfrom\u001b[0m \u001b[0mpylab\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mrcParams\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      4\u001b[0m \u001b[0mget_ipython\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mrun_line_magic\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m'matplotlib'\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m'inline'\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      5\u001b[0m \u001b[0mrcParams\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m'figure.figsize'\u001b[0m\u001b[0;34m]\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0;34m(\u001b[0m\u001b[0;36m14\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m10\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
      "\u001b[0;32m~/conda/envs/python/lib/python3.6/site-packages/mpl_toolkits/basemap/__init__.py\u001b[0m in \u001b[0;36m<module>\u001b[0;34m\u001b[0m\n\u001b[1;32m     24\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     25\u001b[0m \u001b[0;32mfrom\u001b[0m \u001b[0mmatplotlib\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0m__version__\u001b[0m \u001b[0;32mas\u001b[0m \u001b[0m_matplotlib_version\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 26\u001b[0;31m \u001b[0;32mfrom\u001b[0m \u001b[0mmatplotlib\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mcbook\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mdedent\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m     27\u001b[0m \u001b[0;31m# check to make sure matplotlib is not too old.\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     28\u001b[0m \u001b[0m_matplotlib_version\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mLooseVersion\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0m_matplotlib_version\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
      "\u001b[0;31mImportError\u001b[0m: cannot import name 'dedent'"
     ]
    }
   ],
   "source": [
    "from mpl_toolkits.basemap import Basemap\n",
    "import matplotlib.pyplot as plt\n",
    "from pylab import rcParams\n",
    "%matplotlib inline\n",
    "rcParams['figure.figsize'] = (14,10)\n",
    "\n",
    "my_map = Basemap(projection='merc',\n",
    "            resolution = 'l', area_thresh = 1000.0,\n",
    "            llcrnrlon=llon, llcrnrlat=llat, #min longitude (llcrnrlon) and latitude (llcrnrlat)\n",
    "            urcrnrlon=ulon, urcrnrlat=ulat) #max longitude (urcrnrlon) and latitude (urcrnrlat)\n",
    "\n",
    "my_map.drawcoastlines()\n",
    "my_map.drawcountries()\n",
    "#my_map.drawmapboundary()\n",
    "my_map.fillcontinents(color = 'white', alpha = 0.3)\n",
    "my_map.shadedrelief()\n",
    "\n",
    "# To create a color map\n",
    "colors = plt.get_cmap('jet')(np.linspace(0.0, 1.0, clusterNum))\n",
    "\n",
    "\n",
    "\n",
    "#Visualization1\n",
    "for clust_number in set(labels):\n",
    "    c=(([0.4,0.4,0.4]) if clust_number == -1 else colors[np.int(clust_number)])\n",
    "    clust_set = pdf[pdf.Clus_Db == clust_number]                    \n",
    "    my_map.scatter(clust_set.xm, clust_set.ym, color =c,  marker='o', s= 20, alpha = 0.85)\n",
    "    if clust_number != -1:\n",
    "        cenx=np.mean(clust_set.xm) \n",
    "        ceny=np.mean(clust_set.ym) \n",
    "        plt.text(cenx,ceny,str(clust_number), fontsize=25, color='red',)\n",
    "        print (\"Cluster \"+str(clust_number)+', Avg Temp: '+ str(np.mean(clust_set.Tm)))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 7- Clustering of stations based on their location, mean, max, and min Temperature\n",
    "\n",
    "In this section we re-run DBSCAN, but this time on a 5-dimensional dataset:\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "ename": "KeyError",
     "evalue": "\"['ym', 'xm'] not in index\"",
     "output_type": "error",
     "traceback": [
      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[0;31mKeyError\u001b[0m                                  Traceback (most recent call last)",
      "\u001b[0;32m<ipython-input-18-544e7ecd4e3f>\u001b[0m in \u001b[0;36m<module>\u001b[0;34m\u001b[0m\n\u001b[1;32m      3\u001b[0m \u001b[0;32mfrom\u001b[0m \u001b[0msklearn\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mpreprocessing\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mStandardScaler\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      4\u001b[0m \u001b[0msklearn\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mutils\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mcheck_random_state\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;36m1000\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m----> 5\u001b[0;31m \u001b[0mClus_dataSet\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mpdf\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m'xm'\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m'ym'\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m'Tx'\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m'Tm'\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m'Tn'\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m      6\u001b[0m \u001b[0mClus_dataSet\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mnp\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mnan_to_num\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mClus_dataSet\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      7\u001b[0m \u001b[0mClus_dataSet\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mStandardScaler\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mfit_transform\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mClus_dataSet\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
      "\u001b[0;32m~/conda/envs/python/lib/python3.6/site-packages/pandas/core/frame.py\u001b[0m in \u001b[0;36m__getitem__\u001b[0;34m(self, key)\u001b[0m\n\u001b[1;32m   2804\u001b[0m             \u001b[0;32mif\u001b[0m \u001b[0mis_iterator\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   2805\u001b[0m                 \u001b[0mkey\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mlist\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m-> 2806\u001b[0;31m             \u001b[0mindexer\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mloc\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_get_listlike_indexer\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0maxis\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0;36m1\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mraise_missing\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0;32mTrue\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;36m1\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m   2807\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   2808\u001b[0m         \u001b[0;31m# take() does not accept boolean indexers\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
      "\u001b[0;32m~/conda/envs/python/lib/python3.6/site-packages/pandas/core/indexing.py\u001b[0m in \u001b[0;36m_get_listlike_indexer\u001b[0;34m(self, key, axis, raise_missing)\u001b[0m\n\u001b[1;32m   1551\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   1552\u001b[0m         self._validate_read_indexer(\n\u001b[0;32m-> 1553\u001b[0;31m             \u001b[0mkeyarr\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mindexer\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mo\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_get_axis_number\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0maxis\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mraise_missing\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mraise_missing\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m   1554\u001b[0m         )\n\u001b[1;32m   1555\u001b[0m         \u001b[0;32mreturn\u001b[0m \u001b[0mkeyarr\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mindexer\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
      "\u001b[0;32m~/conda/envs/python/lib/python3.6/site-packages/pandas/core/indexing.py\u001b[0m in \u001b[0;36m_validate_read_indexer\u001b[0;34m(self, key, indexer, axis, raise_missing)\u001b[0m\n\u001b[1;32m   1644\u001b[0m             \u001b[0;32mif\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0;34m(\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mname\u001b[0m \u001b[0;34m==\u001b[0m \u001b[0;34m\"loc\"\u001b[0m \u001b[0;32mand\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0mraise_missing\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   1645\u001b[0m                 \u001b[0mnot_found\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mlist\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mset\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[0;34m)\u001b[0m \u001b[0;34m-\u001b[0m \u001b[0mset\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0max\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m-> 1646\u001b[0;31m                 \u001b[0;32mraise\u001b[0m \u001b[0mKeyError\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34mf\"{not_found} not in index\"\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m   1647\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m   1648\u001b[0m             \u001b[0;31m# we skip the warning on Categorical/Interval\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
      "\u001b[0;31mKeyError\u001b[0m: \"['ym', 'xm'] not in index\""
     ]
    }
   ],
   "source": [
    "from sklearn.cluster import DBSCAN\n",
    "import sklearn.utils\n",
    "from sklearn.preprocessing import StandardScaler\n",
    "sklearn.utils.check_random_state(1000)\n",
    "Clus_dataSet = pdf[['xm','ym','Tx','Tm','Tn']]\n",
    "Clus_dataSet = np.nan_to_num(Clus_dataSet)\n",
    "Clus_dataSet = StandardScaler().fit_transform(Clus_dataSet)\n",
    "\n",
    "# Compute DBSCAN\n",
    "db = DBSCAN(eps=0.3, min_samples=10).fit(Clus_dataSet)\n",
    "core_samples_mask = np.zeros_like(db.labels_, dtype=bool)\n",
    "core_samples_mask[db.core_sample_indices_] = True\n",
    "labels = db.labels_\n",
    "pdf[\"Clus_Db\"]=labels\n",
    "\n",
    "realClusterNum=len(set(labels)) - (1 if -1 in labels else 0)\n",
    "clusterNum = len(set(labels)) \n",
    "\n",
    "\n",
    "# A sample of clusters\n",
    "pdf[[\"Stn_Name\",\"Tx\",\"Tm\",\"Clus_Db\"]].head(5)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 8- Visualization of clusters based on location and Temperture\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "ename": "ImportError",
     "evalue": "cannot import name 'dedent'",
     "output_type": "error",
     "traceback": [
      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[0;31mImportError\u001b[0m                               Traceback (most recent call last)",
      "\u001b[0;32m<ipython-input-19-814b2feba22e>\u001b[0m in \u001b[0;36m<module>\u001b[0;34m\u001b[0m\n\u001b[0;32m----> 1\u001b[0;31m \u001b[0;32mfrom\u001b[0m \u001b[0mmpl_toolkits\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mbasemap\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mBasemap\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m      2\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mmatplotlib\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mpyplot\u001b[0m \u001b[0;32mas\u001b[0m \u001b[0mplt\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      3\u001b[0m \u001b[0;32mfrom\u001b[0m \u001b[0mpylab\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mrcParams\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      4\u001b[0m \u001b[0mget_ipython\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mrun_line_magic\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m'matplotlib'\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m'inline'\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m      5\u001b[0m \u001b[0mrcParams\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m'figure.figsize'\u001b[0m\u001b[0;34m]\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0;34m(\u001b[0m\u001b[0;36m14\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;36m10\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
      "\u001b[0;32m~/conda/envs/python/lib/python3.6/site-packages/mpl_toolkits/basemap/__init__.py\u001b[0m in \u001b[0;36m<module>\u001b[0;34m\u001b[0m\n\u001b[1;32m     24\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     25\u001b[0m \u001b[0;32mfrom\u001b[0m \u001b[0mmatplotlib\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0m__version__\u001b[0m \u001b[0;32mas\u001b[0m \u001b[0m_matplotlib_version\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 26\u001b[0;31m \u001b[0;32mfrom\u001b[0m \u001b[0mmatplotlib\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mcbook\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mdedent\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m     27\u001b[0m \u001b[0;31m# check to make sure matplotlib is not too old.\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m     28\u001b[0m \u001b[0m_matplotlib_version\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mLooseVersion\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0m_matplotlib_version\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n",
      "\u001b[0;31mImportError\u001b[0m: cannot import name 'dedent'"
     ]
    }
   ],
   "source": [
    "from mpl_toolkits.basemap import Basemap\n",
    "import matplotlib.pyplot as plt\n",
    "from pylab import rcParams\n",
    "%matplotlib inline\n",
    "rcParams['figure.figsize'] = (14,10)\n",
    "\n",
    "my_map = Basemap(projection='merc',\n",
    "            resolution = 'l', area_thresh = 1000.0,\n",
    "            llcrnrlon=llon, llcrnrlat=llat, #min longitude (llcrnrlon) and latitude (llcrnrlat)\n",
    "            urcrnrlon=ulon, urcrnrlat=ulat) #max longitude (urcrnrlon) and latitude (urcrnrlat)\n",
    "\n",
    "my_map.drawcoastlines()\n",
    "my_map.drawcountries()\n",
    "#my_map.drawmapboundary()\n",
    "my_map.fillcontinents(color = 'white', alpha = 0.3)\n",
    "my_map.shadedrelief()\n",
    "\n",
    "# To create a color map\n",
    "colors = plt.get_cmap('jet')(np.linspace(0.0, 1.0, clusterNum))\n",
    "\n",
    "\n",
    "\n",
    "#Visualization1\n",
    "for clust_number in set(labels):\n",
    "    c=(([0.4,0.4,0.4]) if clust_number == -1 else colors[np.int(clust_number)])\n",
    "    clust_set = pdf[pdf.Clus_Db == clust_number]                    \n",
    "    my_map.scatter(clust_set.xm, clust_set.ym, color =c,  marker='o', s= 20, alpha = 0.85)\n",
    "    if clust_number != -1:\n",
    "        cenx=np.mean(clust_set.xm) \n",
    "        ceny=np.mean(clust_set.ym) \n",
    "        plt.text(cenx,ceny,str(clust_number), fontsize=25, color='red',)\n",
    "        print (\"Cluster \"+str(clust_number)+', Avg Temp: '+ str(np.mean(clust_set.Tm)))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Want to learn more?\n",
    "\n",
    "IBM SPSS Modeler is a comprehensive analytics platform that has many machine learning algorithms. It has been designed to bring predictive intelligence to decisions made by individuals, by groups, by systems – by your enterprise as a whole. A free trial is available through this course, available here: [SPSS Modeler](https://cocl.us/ML0101EN-SPSSModeler).\n",
    "\n",
    "Also, you can use Watson Studio to run these notebooks faster with bigger datasets. Watson Studio is IBM's leading cloud solution for data scientists, built by data scientists. With Jupyter notebooks, RStudio, Apache Spark and popular libraries pre-packaged in the cloud, Watson Studio enables data scientists to collaborate on their projects without having to install anything. Join the fast-growing community of Watson Studio users today with a free account at [Watson Studio](https://cocl.us/ML0101EN_DSX)\n",
    "\n",
    "### Thanks for completing this lesson!\n",
    "\n",
    "Notebook created by: <a href = \"https://ca.linkedin.com/in/saeedaghabozorgi\">Saeed Aghabozorgi</a>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "| Date (YYYY-MM-DD) | Version | Changed By | Change Description    |\n",
    "| ----------------- | ------- | ---------- | --------------------- |\n",
    "| 2020-08-04        | 0       | Nayef      | Upload file to Gitlab |\n",
    "|                   |         |            |                       |\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<hr>\n",
    "Copyright &copy; 2018 [Cognitive Class](https://cocl.us/DX0108EN_CC). This notebook and its source code are released under the terms of the [MIT License](https://bigdatauniversity.com/mit-license/).​\n"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python",
   "language": "python",
   "name": "conda-env-python-py"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.11"
  },
  "widgets": {
   "state": {},
   "version": "1.1.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}