notebooks/DEACoastlines_generation_CLI.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "69da8225-7681-4de4-b1b5-be4fdabf52c7",
   "metadata": {
    "tags": []
   },
   "source": [
    "# DEA Coastlines generation using command line tools <img align=\"right\" src=\"https://github.com/GeoscienceAustralia/dea-notebooks/raw/develop/Supplementary_data/dea_logo.jpg\">\n",
    "This notebook demonstrates how to run a DEA Coastlines analysis using command line tools."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "81b6c48d-db3b-4f30-82fa-67c96e64cc1c",
   "metadata": {},
   "source": [
    "### Setup"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "4e436c72-fa98-489e-bc7d-787ead143e76",
   "metadata": {},
   "source": [
    "Set working directory to top level of repo to ensure links work correctly:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "c0c743c8-8d0d-4f71-9a70-c4132adaaa86",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "/home/jovyan/Robbi/dea-coastlines\n"
     ]
    }
   ],
   "source": [
    "cd .."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "c0ec2b5f-36a1-423b-add1-80f50f07361a",
   "metadata": {},
   "source": [
    "Update required packages:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "cb80bb63-817e-4098-a92d-19a3701d8958",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[33mWARNING: You are using pip version 22.0.2; however, version 22.3.1 is available.\n",
      "You should consider upgrading via the '/env/bin/python -m pip install --upgrade pip' command.\u001b[0m\u001b[33m\n",
      "\u001b[0mNote: you may need to restart the kernel to use updated packages.\n"
     ]
    }
   ],
   "source": [
    "pip install -r requirements.in --quiet"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "ccd976ef-d89d-494b-9c84-84120bf963b9",
   "metadata": {},
   "source": [
    "Set analysis parameters:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "id": "4729d261-6b27-4a61-a937-366c5174ce05",
   "metadata": {},
   "outputs": [],
   "source": [
    "# study_area = 424\n",
    "# raster_version = 'testing'\n",
    "# vector_version = 'testing'\n",
    "# continental_version = 'testing'\n",
    "# config_path = 'configs/dea_coastlines_config.yaml'\n",
    "\n",
    "study_area = 9\n",
    "raster_version = 'development'\n",
    "vector_version = 'development'\n",
    "continental_version = 'development'\n",
    "config_path = 'configs/dea_coastlines_config_development.yaml'"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "d9906d6b-01a4-4c94-8dd0-178eb281bd6a",
   "metadata": {},
   "source": [
    "### Run DEA Coastlines analysis\n",
    "#### Run tidally-constrained raster generation"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "id": "dc5632c4-f872-46e5-9762-80b8556f3622",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Usage: python -m coastlines.raster [OPTIONS]\n",
      "\n",
      "Options:\n",
      "  --config_path TEXT              Path to the YAML config file defining inputs\n",
      "                                  to use for this analysis. These are\n",
      "                                  typically located in the `dea-\n",
      "                                  coastlines/configs/` directory.  [required]\n",
      "  --study_area TEXT               A string providing a unique ID of an\n",
      "                                  analysis gridcell that will be used to run\n",
      "                                  the analysis. This should match a row in the\n",
      "                                  \"id\" column of the provided analysis\n",
      "                                  gridcell vector file.  [required]\n",
      "  --raster_version TEXT           A unique string proving a name that will be\n",
      "                                  used for output raster directories and\n",
      "                                  files. This can be used to version different\n",
      "                                  analysis outputs.  [required]\n",
      "  --start_year INTEGER            The first annual shoreline you wish to be\n",
      "                                  included in the final outputs. To allow low\n",
      "                                  data pixels to be gapfilled with additional\n",
      "                                  satellite data from neighbouring years, the\n",
      "                                  full timeseries of satellite data loaded in\n",
      "                                  this step will include one additional year\n",
      "                                  of preceding satellite data (i.e. if\n",
      "                                  `--start_year 2000`, satellite data from\n",
      "                                  1999 onward will be loaded for gapfilling\n",
      "                                  purposes). Because of this, we recommend\n",
      "                                  that at least one year of satellite data\n",
      "                                  exists in your datacube prior to\n",
      "                                  `--start_year`.\n",
      "  --end_year INTEGER              The final annual shoreline you wish to be\n",
      "                                  included in the final outputs. To allow low\n",
      "                                  data pixels to be gapfilled with additional\n",
      "                                  satellite data from neighbouring years, the\n",
      "                                  full timeseries of satellite data loaded in\n",
      "                                  this step will include one additional year\n",
      "                                  of ensuing satellite data (i.e. if\n",
      "                                  `--end_year 2020`, satellite data up to and\n",
      "                                  including 2021 will be loaded for gapfilling\n",
      "                                  purposes). Because of this, we recommend\n",
      "                                  that at least one year of satellite data\n",
      "                                  exists in your datacube after `--end_year`.\n",
      "  --tide_centre FLOAT             The central tide height used to compute the\n",
      "                                  min and max tide height cutoffs. Tide\n",
      "                                  heights will be masked so all satellite\n",
      "                                  observations are approximately centred over\n",
      "                                  this value. The default is 0.0 which\n",
      "                                  represents 0 m Above Mean Sea Level.\n",
      "  --aws_unsigned / --no-aws_unsigned\n",
      "                                  Whether to use sign AWS requests for S3\n",
      "                                  access\n",
      "  --overwrite / --no-overwrite    Whether to overwrite tiles with existing\n",
      "                                  outputs, or skip these tiles entirely.\n",
      "  --help                          Show this message and exit.\n"
     ]
    }
   ],
   "source": [
    "!python -m coastlines.raster --help"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "fca95348-eda9-4071-a9a1-a3f9219c5cf0",
   "metadata": {},
   "source": [
    "Example analysis:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "id": "47397eb8-ddec-46c6-9f7c-431a50bb7eae",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "/env/lib/python3.8/site-packages/distributed/node.py:180: UserWarning: Port 8787 is already in use.\n",
      "Perhaps you already have a cluster running?\n",
      "Hosting the HTTP server on port 38341 instead\n",
      "  warnings.warn(\n",
      "<Client: 'tcp:https://127.0.0.1:41371' processes=1 threads=7, memory=59.21 GiB>\n",
      "2023-01-30 02:03:44 INFO Study area 9: Loaded study area grid\n",
      "2023-01-30 02:04:00 INFO Study area 9: Loaded virtual product\n",
      "Creating reduced resolution tide modelling array\n",
      "Modelling tides using FES2014 tide model\n",
      "2023-01-30 02:04:00 ERROR Study area 9: Unable to access tide modelling files\n",
      "Traceback (most recent call last):\n",
      "  File \"/home/jovyan/Robbi/dea-coastlines/coastlines/raster.py\", line 569, in generate_rasters\n",
      "    ds[\"tide_m\"], tides_lowres = pixel_tides(ds, resample=True, directory='blah')\n",
      "  File \"/env/lib/python3.8/site-packages/dea_tools/coastal.py\", line 592, in pixel_tides\n",
      "    tide_df = model_tides(\n",
      "  File \"/env/lib/python3.8/site-packages/dea_tools/coastal.py\", line 336, in model_tides\n",
      "    model = pyTMD.model(directory, format=\"netcdf\", compressed=False).elevation(model)\n",
      "  File \"/env/lib/python3.8/site-packages/pyTMD/model.py\", line 842, in elevation\n",
      "    self.model_file = self.pathfinder(model_files)\n",
      "  File \"/env/lib/python3.8/site-packages/pyTMD/model.py\", line 1425, in pathfinder\n",
      "    raise FileNotFoundError(output_file)\n",
      "FileNotFoundError: ['blah/fes2014/ocean_tide/2n2.nc', 'blah/fes2014/ocean_tide/eps2.nc', 'blah/fes2014/ocean_tide/j1.nc', 'blah/fes2014/ocean_tide/k1.nc', 'blah/fes2014/ocean_tide/k2.nc', 'blah/fes2014/ocean_tide/l2.nc', 'blah/fes2014/ocean_tide/la2.nc', 'blah/fes2014/ocean_tide/m2.nc', 'blah/fes2014/ocean_tide/m3.nc', 'blah/fes2014/ocean_tide/m4.nc', 'blah/fes2014/ocean_tide/m6.nc', 'blah/fes2014/ocean_tide/m8.nc', 'blah/fes2014/ocean_tide/mf.nc', 'blah/fes2014/ocean_tide/mks2.nc', 'blah/fes2014/ocean_tide/mm.nc', 'blah/fes2014/ocean_tide/mn4.nc', 'blah/fes2014/ocean_tide/ms4.nc', 'blah/fes2014/ocean_tide/msf.nc', 'blah/fes2014/ocean_tide/msqm.nc', 'blah/fes2014/ocean_tide/mtm.nc', 'blah/fes2014/ocean_tide/mu2.nc', 'blah/fes2014/ocean_tide/n2.nc', 'blah/fes2014/ocean_tide/n4.nc', 'blah/fes2014/ocean_tide/nu2.nc', 'blah/fes2014/ocean_tide/o1.nc', 'blah/fes2014/ocean_tide/p1.nc', 'blah/fes2014/ocean_tide/q1.nc', 'blah/fes2014/ocean_tide/r2.nc', 'blah/fes2014/ocean_tide/s1.nc', 'blah/fes2014/ocean_tide/s2.nc', 'blah/fes2014/ocean_tide/s4.nc', 'blah/fes2014/ocean_tide/sa.nc', 'blah/fes2014/ocean_tide/ssa.nc', 'blah/fes2014/ocean_tide/t2.nc']\n"
     ]
    }
   ],
   "source": [
    "!python -m coastlines.raster --config_path {config_path} --study_area {study_area} --raster_version {raster_version} --start_year 1988 --end_year 2021"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "1e0f60ac-c68d-4b6f-a19b-257679588ea1",
   "metadata": {},
   "source": [
    "#### Run vector annual shoreline and rates of change statistics generation"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "id": "0ed72c21-ba89-4fad-9521-f5493aad9d66",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Usage: python -m coastlines.vector [OPTIONS]\n",
      "\n",
      "Options:\n",
      "  --config_path TEXT              Path to the YAML config file defining inputs\n",
      "                                  to use for this analysis. These are\n",
      "                                  typically located in the `dea-\n",
      "                                  coastlines/configs/` directory.  [required]\n",
      "  --study_area TEXT               A string providing a unique ID of an\n",
      "                                  analysis gridcell that was previously used\n",
      "                                  to generate raster files. This is used to\n",
      "                                  identify the raster files that will be used\n",
      "                                  as inputs for shoreline extraction, and\n",
      "                                  should match a row in the \"id\" column of the\n",
      "                                  provided analysis gridcell vector file.\n",
      "                                  [required]\n",
      "  --raster_version TEXT           A unique string providing a name that was\n",
      "                                  used to generate raster files. This is used\n",
      "                                  to identify the raster files that will be\n",
      "                                  used as inputs for shoreline extraction.\n",
      "                                  [required]\n",
      "  --vector_version TEXT           A unique string proving a name that will be\n",
      "                                  used for output vector directories and\n",
      "                                  files. This allows multiple versions of\n",
      "                                  vector files to be generated from the same\n",
      "                                  input raster data, e.g. for testing\n",
      "                                  different water index thresholds or indices.\n",
      "                                  If not provided, this will default to the\n",
      "                                  same string supplied to \"--raster_version\".\n",
      "  --water_index TEXT              A string giving the name of the computed\n",
      "                                  water index to use for shoreline extraction.\n",
      "                                  Defaults to \"mndwi\".\n",
      "  --index_threshold FLOAT         The water index threshold used to extract\n",
      "                                  subpixel precision shorelines. Defaults to\n",
      "                                  0.00.\n",
      "  --start_year INTEGER            The first annual shoreline to extract from\n",
      "                                  the input raster data.\n",
      "  --end_year INTEGER              The final annual shoreline to extract from\n",
      "                                  the input raster data.\n",
      "  --baseline_year INTEGER         The annual shoreline used as a baseline from\n",
      "                                  which to generate the rates of change point\n",
      "                                  statistics. This is typically the most\n",
      "                                  recent annual shoreline in the dataset (i.e.\n",
      "                                  the same as `--end_year`).\n",
      "  --aws_unsigned / --no-aws_unsigned\n",
      "                                  Whether to use sign AWS requests for S3\n",
      "                                  access\n",
      "  --overwrite / --no-overwrite    Whether to overwrite tiles with existing\n",
      "                                  outputs, or skip these tiles entirely.\n",
      "  --help                          Show this message and exit.\n"
     ]
    }
   ],
   "source": [
    "!python -m coastlines.vector --help"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "0dede36a-c26b-4d98-a359-7080dc3f2fd9",
   "metadata": {},
   "source": [
    "Example analysis:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "id": "c23665e0-6d46-4185-b9f0-04a50d856174",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "2023-01-25 02:10:51 INFO Study area 424: Starting vector generation\n",
      "2023-01-25 02:10:59 INFO Study area 424: Loaded rasters\n",
      "2023-01-25 02:11:12 ERROR Study area 424: Failed to run process with error 'Dataset' object has no attribute 'land'\n",
      "Traceback (most recent call last):\n",
      "  File \"/home/jovyan/Robbi/dea-coastlines/coastlines/vector.py\", line 1820, in generate_vectors_cli\n",
      "    generate_vectors(\n",
      "  File \"/home/jovyan/Robbi/dea-coastlines/coastlines/vector.py\", line 1443, in generate_vectors\n",
      "    masked_ds, certainty_masks = contours_preprocess(\n",
      "  File \"/home/jovyan/Robbi/dea-coastlines/coastlines/vector.py\", line 616, in contours_preprocess\n",
      "    geodata_da = dc.load(\n",
      "  File \"/env/lib/python3.8/site-packages/xarray/core/common.py\", line 239, in __getattr__\n",
      "    raise AttributeError(\n",
      "AttributeError: 'Dataset' object has no attribute 'land'\n"
     ]
    }
   ],
   "source": [
    "!python -m coastlines.vector --config_path {config_path} --study_area {study_area} --raster_version {raster_version} --start_year 1988 --end_year 2021 --baseline_year 2021"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "fa26bb5f-c618-418d-bc87-c01a33fd612c",
   "metadata": {},
   "source": [
    "#### Run continental-scale layer generation"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "518bf214-ce70-4baa-a2ad-28302986fe01",
   "metadata": {},
   "outputs": [],
   "source": [
    "!python -m coastlines.continental --help"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "51249ca9-35ca-4baa-b6a1-67f149a6fef0",
   "metadata": {},
   "source": [
    "Example analysis:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "22e3dca9-6a5e-4e6a-ac2c-c3f3b1ae904b",
   "metadata": {},
   "outputs": [],
   "source": [
    "!python -m coastlines.continental --vector_version {vector_version} --continental_version {continental_version} --shorelines True --ratesofchange True --hotspots True --baseline_year 2021"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "fe55ab27-807a-44c8-9408-595934893faa",
   "metadata": {},
   "source": [
    "## Example combined analysis\n",
    "This demonstrates how the three components of DEA Coastlines (raster generation, vector generation and continental layers generation) can be applied automatically to a sequence of input study area grid cells."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "id": "6b804fec-39f4-48a9-8525-a78fbf06e084",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Study areas\n",
    "study_areas = [193, 478]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "id": "c39e6533-f4fd-4a3c-90a5-44f19825c2f5",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "193\n",
      "<Client: 'tcp:https://127.0.0.1:45241' processes=1 threads=31, memory=237.21 GiB>\n",
      "2023-01-25 02:11:18 INFO Study area 193: Loaded study area grid\n",
      "2023-01-25 02:11:29 INFO Study area 193: Loaded virtual product\n",
      "Creating reduced resolution tide modelling array\n",
      "Modelling tides using FES2014 tide model\n",
      "Reprojecting tides into original array\n",
      "100%|███████████████████████████████████████| 1074/1074 [00:13<00:00, 76.98it/s]\n",
      "2023-01-25 02:12:23 INFO Study area 193: Finished modelling tide heights\n",
      "2023-01-25 02:12:23 INFO Study area 193: Calculating low and high tide cutoffs for each pixel\n",
      "2023-01-25 02:12:23 INFO Study area 193: Started exporting raster data\n",
      "2023-01-25 02:16:59 INFO Study area 193: Completed exporting raster data\n",
      "distributed.nanny - WARNING - Worker process still alive after 3.9999988555908206 seconds, killing\n",
      "Exception in thread AsyncProcess Dask Worker process (from Nanny) watch process join:\n",
      "Traceback (most recent call last):\n",
      "  File \"/usr/lib/python3.8/threading.py\", line 932, in _bootstrap_inner\n",
      "    self.run()\n",
      "  File \"/usr/lib/python3.8/threading.py\", line 870, in run\n",
      "2023-01-25 02:17:07 INFO Study area 193: Starting vector generation\n",
      "2023-01-25 02:17:18 INFO Study area 193: Loaded rasters\n",
      "Operating in single z-value, multiple arrays mode\n",
      "Failed to generate contours: 1988, 1989, 1992, 1993\n",
      "2023-01-25 02:17:47 INFO Study area 193: Extracted shorelines from raster data\n",
      "2023-01-25 02:17:47 INFO Study area 193: Extracted rates of change points\n",
      "2023-01-25 02:17:48 INFO Study area 193: Calculated distances to each annual shoreline\n",
      "2023-01-25 02:17:48 INFO Study area 193: Calculated rates of change regressions\n",
      "2023-01-25 02:17:48 INFO Study area 193: Calculated all of time statistics\n",
      "2023-01-25 02:17:48 INFO Study area 193: Calculated rate of change certainty flags\n",
      "2023-01-25 02:17:48 INFO Study area 193: Added region attributes and geohash UIDs\n",
      "2023-01-25 02:17:48 ERROR Study area 193: Failed to run process with error Study area 193: No vector points data to export after clipping to study area extent\n",
      "Traceback (most recent call last):\n",
      "  File \"/home/jovyan/Robbi/dea-coastlines/coastlines/vector.py\", line 1622, in generate_vectors\n",
      "    points_gdf.to_crs(\"EPSG:4326\").to_file(\n",
      "  File \"/env/lib/python3.8/site-packages/geopandas/geodataframe.py\", line 1114, in to_file\n",
      "    _to_file(self, filename, driver, schema, index, **kwargs)\n",
      "  File \"/env/lib/python3.8/site-packages/geopandas/io/file.py\", line 367, in _to_file\n",
      "    schema = infer_schema(df)\n",
      "  File \"/env/lib/python3.8/site-packages/geopandas/io/file.py\", line 428, in infer_schema\n",
      "    raise ValueError(\"Cannot write empty DataFrame to file.\")\n",
      "ValueError: Cannot write empty DataFrame to file.\n",
      "\n",
      "During handling of the above exception, another exception occurred:\n",
      "\n",
      "Traceback (most recent call last):\n",
      "  File \"/home/jovyan/Robbi/dea-coastlines/coastlines/vector.py\", line 1820, in generate_vectors_cli\n",
      "    generate_vectors(\n",
      "  File \"/home/jovyan/Robbi/dea-coastlines/coastlines/vector.py\", line 1637, in generate_vectors\n",
      "    raise ValueError(\n",
      "ValueError: Study area 193: No vector points data to export after clipping to study area extent\n",
      "478\n",
      "<Client: 'tcp:https://127.0.0.1:46233' processes=1 threads=31, memory=237.21 GiB>\n",
      "2023-01-25 02:17:55 INFO Study area 478: Loaded study area grid\n",
      "2023-01-25 02:18:01 INFO Study area 478: Loaded virtual product\n",
      "Creating reduced resolution tide modelling array\n",
      "Modelling tides using FES2014 tide model\n",
      "Reprojecting tides into original array\n",
      "100%|███████████████████████████████████████| 1405/1405 [00:17<00:00, 80.45it/s]\n",
      "2023-01-25 02:19:01 INFO Study area 478: Finished modelling tide heights\n",
      "2023-01-25 02:19:02 INFO Study area 478: Calculating low and high tide cutoffs for each pixel\n",
      "2023-01-25 02:19:02 INFO Study area 478: Started exporting raster data\n",
      "2023-01-25 02:24:52 INFO Study area 478: Completed exporting raster data\n",
      "distributed.nanny - WARNING - Worker process still alive after 3.9999990463256836 seconds, killing\n",
      "2023-01-25 02:24:59 INFO Study area 478: Starting vector generation\n",
      "2023-01-25 02:25:10 INFO Study area 478: Loaded rasters\n",
      "Operating in single z-value, multiple arrays mode\n",
      "Failed to generate any valid contours; verify that values passed to `z_values` are valid and present in `da`\n",
      "2023-01-25 02:25:39 ERROR Study area 478: Failed to run process with error Study area 478: Unable to extract any valid shorelines from raster data\n",
      "Traceback (most recent call last):\n",
      "  File \"/home/jovyan/Robbi/dea-coastlines/coastlines/vector.py\", line 1820, in generate_vectors_cli\n",
      "    generate_vectors(\n",
      "  File \"/home/jovyan/Robbi/dea-coastlines/coastlines/vector.py\", line 1461, in generate_vectors\n",
      "    raise ValueError(\n",
      "ValueError: Study area 478: Unable to extract any valid shorelines from raster data\n"
     ]
    }
   ],
   "source": [
    "# Run raster and vector generation for each study area\n",
    "for study_area in study_areas:\n",
    "    print(study_area)\n",
    "    !python -m coastlines.raster --config_path {config_path} --study_area {study_area} --raster_version {raster_version} --start_year 1988 --end_year 2021\n",
    "    !python -m coastlines.vector --config_path {config_path} --study_area {study_area} --raster_version {raster_version} --vector_version {vector_version} --start_year 1988 --end_year 2021 --baseline_year 2021\n",
    "\n",
    "# When complete, combine into single continental outputs\n",
    "# !python -m coastlines.continental --vector_version {vector_version} --continental_version {continental_version} --shorelines True --ratesofchange True --hotspots True --baseline_year 2021"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "3f83a811-d875-4c27-9f9e-3e644119b49f",
   "metadata": {
    "tags": []
   },
   "source": [
    "### Clean up and remove files\n",
    "Warning: this will delete all data processed with a matching unique version name. Only run these cells if you no longer need these processed outputs!"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "585af34b-9cde-4ff2-8fa5-5c2baaab2e79",
   "metadata": {},
   "outputs": [],
   "source": [
    "# rm -rf data/interim/raster/{raster_version}"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "f3069daf-5d71-4c70-8740-d02efb1fc0f9",
   "metadata": {},
   "outputs": [],
   "source": [
    "# rm -rf data/interim/vector/{vector_version}"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "38d2209f-e978-4735-835b-68381358517a",
   "metadata": {},
   "outputs": [],
   "source": [
    "# rm -rf data/processed/{continental_version}"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "9d560564-e485-4a02-8f19-0dea1ba42bd3",
   "metadata": {
    "tags": []
   },
   "source": [
    "***\n",
    "\n",
    "## Additional information"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "457f851c-3b51-4c80-8430-d893fdbd05ec",
   "metadata": {},
   "source": [
    "**License:** The code in this notebook is licensed under the [Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0). \n",
    "Digital Earth Australia data is licensed under the [Creative Commons by Attribution 4.0](https://creativecommons.org/licenses/by/4.0/) license.\n",
    "\n",
    "**Contact:** For assistance with any of the Python code or Jupyter Notebooks in this repository, please post a [Github issue](https://github.com/GeoscienceAustralia/dea-coastlines/issues/new).\n",
    "\n",
    "**Last modified:** November 2022\n",
    "\n",
    "**To cite:**\n",
    "\n",
    "> Bishop-Taylor, R., Nanson, R., Sagar, S., Lymburner, L. (2021). Mapping Australia's dynamic coastline at mean sea level using three decades of Landsat imagery. Remote Sensing of Environment, 267, 112734. Available: https://doi.org/10.1016/j.rse.2021.112734\n",
    ">\n",
    "> Nanson, R., Bishop-Taylor, R., Sagar, S., Lymburner, L., (2022). Geomorphic insights into Australia's coastal change using a national dataset derived from the multi-decadal Landsat archive. Estuarine, Coastal and Shelf Science, 265, p.107712. Available: https://doi.org/10.1016/j.ecss.2021.107712\n",
    ">\n",
    "> Bishop-Taylor, R., Sagar, S., Lymburner, L., Alam, I., Sixsmith, J. (2019). Sub-pixel waterline extraction: characterising accuracy and sensitivity to indices and spectra. Remote Sensing, 11 (24):2984. Available: https://doi.org/10.3390/rs11242984"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.10"
  },
  "widgets": {
   "application/vnd.jupyter.widget-state+json": {
    "state": {},
    "version_major": 2,
    "version_minor": 0
   }
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}