"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {},
+ "source": [
+ "## 2. Model Data \n",
"\n",
- "### 2.1 Model output data\n",
+ "### 2.1 Load data \n",
"\n",
- "#### 2.1.1 Load dataset\n",
+ "#### 2.1.1 Open dataset \n",
"\n",
"This demo uses one of the numerous CMIP6 models -- E3SM-1-0. The Sea-Ice Area Percentage (Ocean Grid; 'siconc') and Grid-Cell Area for Ocean Variables ('areacello') variables are needed and can be found in the directories listed below. In addition, six other models are available that can augment the analyses in this demo:\n",
"```\n",
@@ -97,6 +131,15 @@
"- e.g., Search query: https://aims2.llnl.gov/search?project=CMIP6&activeFacets={\"experiment_id\":\"historical\",\"variable_id\":\"siconc\"}"
]
},
+ {
+ "cell_type": "markdown",
+ "metadata": {},
+ "source": [
+ "
"
+ ]
+ },
{
"cell_type": "code",
"execution_count": 2,
@@ -156,7 +199,7 @@
"name": "stderr",
"output_type": "stream",
"text": [
- "2024-02-06 16:09:10,344 [WARNING]: dataset.py(open_dataset:109) >> \"No time coordinates were found in this dataset to decode. If time coordinates were expected to exist, make sure they are detectable by setting the CF 'axis' or 'standard_name' attribute (e.g., ds['time'].attrs['axis'] = 'T' or ds['time'].attrs['standard_name'] = 'time'). Afterwards, try decoding again with `xcdat.decode_time`.\"\n"
+ "2024-02-09 12:08:07,978 [WARNING]: dataset.py(open_dataset:109) >> \"No time coordinates were found in this dataset to decode. If time coordinates were expected to exist, make sure they are detectable by setting the CF 'axis' or 'standard_name' attribute (e.g., ds['time'].attrs['axis'] = 'T' or ds['time'].attrs['standard_name'] = 'time'). Afterwards, try decoding again with `xcdat.decode_time`.\"\n"
]
}
],
@@ -574,7 +617,7 @@
" cmor_version: 3.7.0\n",
" references: Stevenson, S., Huang, X., Zhao, Y., Di Lorenzo, E...\n",
" version: v20230811\n",
- " branch_time_in_parent: 3560.0
2023-01-30T21:36:30Z altered by CMOR: Treated scalar dimension: 'type'. 2023-01-30T21:36:30Z altered by CMOR: replaced missing value flag (9.96921e+36) and corresponding data with standard missing value (1e+20).
2023-01-30T21:36:30Z altered by CMOR: Treated scalar dimension: 'type'. 2023-01-30T21:36:30Z altered by CMOR: replaced missing value flag (9.96921e+36) and corresponding data with standard missing value (1e+20).
data regridded to a CMIP6 standard 1x1 degree lonxlat grid from the native grid using an area-average preserving method.
grid_label :
gr
history :
2023-01-30T21:36:30Z ;rewrote data to be consistent with CMIP for variable siconc found in table SImon.;\n",
+ " dtype='object', length=1944, calendar='noleap', freq='None'))
data regridded to a CMIP6 standard 1x1 degree lonxlat grid from the native grid using an area-average preserving method.
grid_label :
gr
history :
2023-01-30T21:36:30Z ;rewrote data to be consistent with CMIP for variable siconc found in table SImon.;\n",
"20191024.en1.LE_ens_1.ne30_oECv3_ICG.compy
initialization_index :
2
institution :
Bren School of Environmental Science and Management, University of California, Santa Barbara. Mailing address: c/o Samantha Stevenson, 2400 Bren Hall, University of California Santa Barbara, Santa Barbara, CA 93106, USA
institution_id :
UCSB
mip_era :
CMIP6
nominal_resolution :
100 km
parent_activity_id :
CMIP
parent_experiment_id :
piControl
parent_mip_era :
CMIP6
parent_source_id :
E3SM-1-0
parent_time_units :
days since 0001-01-01
parent_variant_label :
r1i1p1f1
physics_index :
2
product :
model-output
project PI :
Sam Stevenson (sstevenson@ucsb.edu), Emanuele Di Lorenzo (e.dilorenzo@brown.edu)
realization_index :
1
realm :
seaIce
source :
E3SM 1.0 (2018): \n",
"aerosol: MAM4 with resuspension, marine organics, and secondary organics (same grid as atmos)\n",
"atmos: EAM (v1.0, cubed sphere spectral-element grid; 5400 elements with p=3; 1 deg average grid spacing; 90 x 90 x 6 longitude/latitude/cubeface; 72 levels; top level 0.1 hPa)\n",
@@ -1354,7 +1397,7 @@
" variable_id: areacello\n",
" variant_label: r1i1p1f1\n",
" license: CMIP6 model data produced by E3SM is licensed und...\n",
- " cmor_version: 3.6.0
data regridded to a CMIP6 standard 1x1 degree lonxlat grid from the native grid using an area-average preserving method.
grid_label :
gr
history :
2021-01-28T04:40:15Z ;rewrote data to be consistent with CMIP for variable areacello found in table Ofx.
initialization_index :
1
institution :
LLNL (Lawrence Livermore National Laboratory, Livermore, CA 94550, USA); ANL (Argonne National Laboratory, Argonne, IL 60439, USA); BNL (Brookhaven National Laboratory, Upton, NY 11973, USA); LANL (Los Alamos National Laboratory, Los Alamos, NM 87545, USA); LBNL (Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA); ORNL (Oak Ridge National Laboratory, Oak Ridge, TN 37831, USA); PNNL (Pacific Northwest National Laboratory, Richland, WA 99352, USA); SNL (Sandia National Laboratories, Albuquerque, NM 87185, USA). Mailing address: LLNL Climate Program, c/o David C. Bader, Principal Investigator, L-103, 7000 East Avenue, Livermore, CA 94550, USA
institution_id :
E3SM-Project
mip_era :
CMIP6
nominal_resolution :
100 km
parent_activity_id :
CMIP
parent_experiment_id :
piControl
parent_mip_era :
CMIP6
parent_source_id :
E3SM-1-0
parent_time_units :
days since 0001-01-01
parent_variant_label :
r1i1p1f1
physics_index :
1
product :
model-output
project PI :
Dave Bader (bader2@llnl.gov)
realization_index :
1
realm :
ocean
references :
Golaz, J.-C., P. M. Caldwell, L. P. Van Roekel and co-authors, 2019: The DOE E3SM coupled model version 1: Overview and evaluation at standard resolution. JAMES, doi: 10.1029/2018MS001603; http://e3sm.org'
data regridded to a CMIP6 standard 1x1 degree lonxlat grid from the native grid using an area-average preserving method.
grid_label :
gr
history :
2021-01-28T04:40:15Z ;rewrote data to be consistent with CMIP for variable areacello found in table Ofx.
initialization_index :
1
institution :
LLNL (Lawrence Livermore National Laboratory, Livermore, CA 94550, USA); ANL (Argonne National Laboratory, Argonne, IL 60439, USA); BNL (Brookhaven National Laboratory, Upton, NY 11973, USA); LANL (Los Alamos National Laboratory, Los Alamos, NM 87545, USA); LBNL (Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA); ORNL (Oak Ridge National Laboratory, Oak Ridge, TN 37831, USA); PNNL (Pacific Northwest National Laboratory, Richland, WA 99352, USA); SNL (Sandia National Laboratories, Albuquerque, NM 87185, USA). Mailing address: LLNL Climate Program, c/o David C. Bader, Principal Investigator, L-103, 7000 East Avenue, Livermore, CA 94550, USA
institution_id :
E3SM-Project
mip_era :
CMIP6
nominal_resolution :
100 km
parent_activity_id :
CMIP
parent_experiment_id :
piControl
parent_mip_era :
CMIP6
parent_source_id :
E3SM-1-0
parent_time_units :
days since 0001-01-01
parent_variant_label :
r1i1p1f1
physics_index :
1
product :
model-output
project PI :
Dave Bader (bader2@llnl.gov)
realization_index :
1
realm :
ocean
references :
Golaz, J.-C., P. M. Caldwell, L. P. Van Roekel and co-authors, 2019: The DOE E3SM coupled model version 1: Overview and evaluation at standard resolution. JAMES, doi: 10.1029/2018MS001603; http://e3sm.org'
source :
E3SM 1.0 (2018): \n",
"aerosol: MAM4 with resuspension, marine organics, and secondary organics (same grid as atmos)\n",
"atmos: EAM (v1.0, cubed sphere spectral-element grid; 5400 elements with p=3; 1 deg average grid spacing; 90 x 90 x 6 longitude/latitude/cubeface; 72 levels; top level 0.1 hPa)\n",
"atmosChem: Troposphere specified oxidants for aerosols. Stratosphere linearized interactive ozone (LINOZ v2) (same grid as atmos)\n",
@@ -1427,7 +1470,22 @@
"cell_type": "markdown",
"metadata": {},
"source": [
- "#### 2.1.2 Visualize the data"
+ "
\n",
+ "\n",
+ "##### a. Quick look\n"
]
},
{
@@ -1445,7 +1503,7 @@
{
"data": {
"text/plain": [
- ""
+ ""
]
},
"execution_count": 7,
@@ -1503,8 +1561,14 @@
"cell_type": "markdown",
"metadata": {},
"source": [
+ "##### b. Snapshot on map\n",
+ "\n",
"Viewing the same data from another angle:\n",
- "- Example mapping scripts are adapted and revised from https://docs.xarray.dev/en/latest/user-guide/plotting.html#maps."
+ "- Example mapping scripts are adapted and revised from https://docs.xarray.dev/en/latest/user-guide/plotting.html#maps.\n",
+ "\n",
+ "
2023-01-30T21:36:30Z altered by CMOR: Treated scalar dimension: 'type'. 2023-01-30T21:36:30Z altered by CMOR: replaced missing value flag (9.96921e+36) and corresponding data with standard missing value (1e+20).
2023-01-30T21:36:30Z altered by CMOR: Treated scalar dimension: 'type'. 2023-01-30T21:36:30Z altered by CMOR: replaced missing value flag (9.96921e+36) and corresponding data with standard missing value (1e+20).
data regridded to a CMIP6 standard 1x1 degree lonxlat grid from the native grid using an area-average preserving method.
grid_label :
gr
history :
2023-01-30T21:36:30Z ;rewrote data to be consistent with CMIP for variable siconc found in table SImon.;\n",
+ " dtype='object', length=1944, calendar='noleap', freq='None'))
data regridded to a CMIP6 standard 1x1 degree lonxlat grid from the native grid using an area-average preserving method.
grid_label :
gr
history :
2023-01-30T21:36:30Z ;rewrote data to be consistent with CMIP for variable siconc found in table SImon.;\n",
"20191024.en1.LE_ens_1.ne30_oECv3_ICG.compy
initialization_index :
2
institution :
Bren School of Environmental Science and Management, University of California, Santa Barbara. Mailing address: c/o Samantha Stevenson, 2400 Bren Hall, University of California Santa Barbara, Santa Barbara, CA 93106, USA
institution_id :
UCSB
mip_era :
CMIP6
nominal_resolution :
100 km
parent_activity_id :
CMIP
parent_experiment_id :
piControl
parent_mip_era :
CMIP6
parent_source_id :
E3SM-1-0
parent_time_units :
days since 0001-01-01
parent_variant_label :
r1i1p1f1
physics_index :
2
product :
model-output
project PI :
Sam Stevenson (sstevenson@ucsb.edu), Emanuele Di Lorenzo (e.dilorenzo@brown.edu)
realization_index :
1
realm :
seaIce
source :
E3SM 1.0 (2018): \n",
"aerosol: MAM4 with resuspension, marine organics, and secondary organics (same grid as atmos)\n",
"atmos: EAM (v1.0, cubed sphere spectral-element grid; 5400 elements with p=3; 1 deg average grid spacing; 90 x 90 x 6 longitude/latitude/cubeface; 72 levels; top level 0.1 hPa)\n",
@@ -2564,7 +2747,7 @@
" branch_time_in_parent: 3560.0"
]
},
- "execution_count": 15,
+ "execution_count": 17,
"metadata": {},
"output_type": "execute_result"
}
@@ -2577,27 +2760,46 @@
"cell_type": "markdown",
"metadata": {},
"source": [
- "## 3. Reference dataset\n",
+ "
"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {},
+ "source": [
+ "## 3. Reference Data \n",
"\n",
"The observational dataset provided is the satellite derived sea ice concentration dataset from EUMETSAT OSI-SAF. More data information can be found at the [osi-450-a product page](https://osi-saf.eumetsat.int/products/osi-450-a). The path to this data is:\n",
"```\n",
"/p/user_pub/pmp/demo/sea-ice/EUMETSAT\n",
- "```"
+ "```\n",
+ "\n",
+ "This data can be also downloaded via the PMP's [Demo #0 notebook](Demo_0_download_data.ipynb).\n",
+ "\n",
+ "### 3.1 Load data \n",
+ "\n",
+ "#### 3.1.1 Open Reference Dataset for Arctic \n",
+ "\n",
+ "
fully filtered concentration of sea ice using atmospheric correction of brightness temperatures and open water filters
standard_name :
sea_ice_area_fraction
units :
%
valid_min :
0
valid_max :
10000
grid_mapping :
Lambert_Azimuthal_Grid
ancillary_variables :
total_standard_uncertainty status_flag
comment :
this field is the primary sea ice concentration estimate for this climate data record
[73903104 values with dtype=float64]
raw_ice_conc_values
(time, yc, xc)
float64
...
long_name :
sea ice concentration estimates as retrieved by the algorithm, and that were edited away by the various filters
units :
%
grid_mapping :
Lambert_Azimuthal_Grid
comment :
this field can be used in combination with 'ice_conc' to access un-bounded normal distribution of sea ice concentration estimates corresponding to the uncertainty estimate in 'total_standard_uncertainty'. It does also feature some amount of un-physical data (below 0% and above 100%).
[73903104 values with dtype=float64]
status_flag
(time, yc, xc)
float32
...
long_name :
status flag bit array for sea ice concentration retrievals
standard_name :
sea_ice_area_fraction status_flag
valid_min :
0
valid_max :
32767
grid_mapping :
Lambert_Azimuthal_Grid
flag_masks :
[ 1 2 4 8 16 32 64 128]
flag_meanings :
land lake open_water_filtered land_spill_over high_t2m spatial_interp temporal_interp max_ice_climo
fully filtered concentration of sea ice using atmospheric correction of brightness temperatures and open water filters
standard_name :
sea_ice_area_fraction
units :
%
valid_min :
0
valid_max :
10000
grid_mapping :
Lambert_Azimuthal_Grid
ancillary_variables :
total_standard_uncertainty status_flag
comment :
this field is the primary sea ice concentration estimate for this climate data record
[73903104 values with dtype=float64]
raw_ice_conc_values
(time, yc, xc)
float64
...
long_name :
sea ice concentration estimates as retrieved by the algorithm, and that were edited away by the various filters
units :
%
grid_mapping :
Lambert_Azimuthal_Grid
comment :
this field can be used in combination with 'ice_conc' to access un-bounded normal distribution of sea ice concentration estimates corresponding to the uncertainty estimate in 'total_standard_uncertainty'. It does also feature some amount of un-physical data (below 0% and above 100%).
[73903104 values with dtype=float64]
status_flag
(time, yc, xc)
float32
...
long_name :
status flag bit array for sea ice concentration retrievals
standard_name :
sea_ice_area_fraction status_flag
valid_min :
0
valid_max :
32767
grid_mapping :
Lambert_Azimuthal_Grid
flag_masks :
[ 1 2 4 8 16 32 64 128]
flag_meanings :
land lake open_water_filtered land_spill_over high_t2m spatial_interp temporal_interp max_ice_climo
flag_descriptions :
\n",
"all bits to 0 (flag 0): Nominal retrieval by the SIC algorithm\n",
"bit 1 (flag 1): Position is over land\n",
"bit 2 (flag 2): Position is lake\n",
@@ -3030,17 +3232,17 @@
"bit 5 (flag 16): Handle with caution, the 2m air temperature is high at this position, and this might be false ice\n",
"bit 6 (flag 32): Value is the result of spatial interpolation\n",
"bit 7 (flag 64): Value is the result of temporal interpolation\n",
- "bit 8 (flag 128): SIC is set to zero since position is outside maximum sea ice climatology.
comment :
Flag values found in the map might be combinations of those listed above. For example flag value 80 (= 2^4 + 2^6 = 16 + 64) indicates high_t2m AND temporal_interp
[73903104 values with dtype=float32]
time_bnds
(time, nv)
object
...
[792 values with dtype=object]
xc_bnds
(xc, bnds)
float64
...
xcdat_bounds :
True
[864 values with dtype=float64]
xc
PandasIndex
PandasIndex(Index([-5387.5, -5362.5, -5337.5, -5312.5, -5287.5, -5262.5, -5237.5, -5212.5,\n",
+ "bit 8 (flag 128): SIC is set to zero since position is outside maximum sea ice climatology.
comment :
Flag values found in the map might be combinations of those listed above. For example flag value 80 (= 2^4 + 2^6 = 16 + 64) indicates high_t2m AND temporal_interp
Monthly Sea Ice Concentration Climate Data Record Version 3 (SMMR, SSM/I, and SSMIS) from the EUMETSAT OSI SAF
summary :
This climate data record of sea ice concentration is obtained from coarse resolution passive microwave satellite data (SMMR, SSM/I, and SSMIS) over the polar regions (Arctic and Antarctic). The processing chain features: 1) dynamic tuning of tie-points and algorithms, 2) correction of atmospheric noise using a Radiative Transfer Model, 3) computation of per-pixel uncertainties, and 4) an optimal hybrid sea ice concentration algorithm. This dataset was generated by the EUMETSAT Ocean and Sea Ice Satellite Application Facility (OSI SAF). The ESA CCI Programme contributed with Research and Development on the algorithms.
All intellectual property rights of the Ocean and Sea Ice SAF products belong to EUMETSAT. The use of these products is granted to every user, free of charge. If users wish to use these products, EUMETSAT's copyright credit must be shown by displaying the words 'Copyright EUMETSAT' under each of the products shown. EUMETSAT offers no warranty and accepts no liability in respect of the Ocean and Sea Ice SAF products. EUMETSAT neither commits to nor guarantees the continuity, availability, or quality or suitability for any purpose of, the Ocean and Sea Ice SAF products.
history :
2023-03-20T12:29:37Z creation
date_created :
2023-03-20
cdm_data_type :
Grid
spatial_resolution :
25.0 km grid spacing
geospatial_bounds_crs :
EPSG:6931
product_version :
3.0
tracking_id :
2d0c7fd8-c092-4cff-9409-421010ba4167
naming_authority :
int.eumetsat
standard_name_vocabulary :
CF Standard Name Table (Version 78, 21 September 2021)
Monthly Sea Ice Concentration Climate Data Record Version 3 (SMMR, SSM/I, and SSMIS) from the EUMETSAT OSI SAF
summary :
This climate data record of sea ice concentration is obtained from coarse resolution passive microwave satellite data (SMMR, SSM/I, and SSMIS) over the polar regions (Arctic and Antarctic). The processing chain features: 1) dynamic tuning of tie-points and algorithms, 2) correction of atmospheric noise using a Radiative Transfer Model, 3) computation of per-pixel uncertainties, and 4) an optimal hybrid sea ice concentration algorithm. This dataset was generated by the EUMETSAT Ocean and Sea Ice Satellite Application Facility (OSI SAF). The ESA CCI Programme contributed with Research and Development on the algorithms.
All intellectual property rights of the Ocean and Sea Ice SAF products belong to EUMETSAT. The use of these products is granted to every user, free of charge. If users wish to use these products, EUMETSAT's copyright credit must be shown by displaying the words 'Copyright EUMETSAT' under each of the products shown. EUMETSAT offers no warranty and accepts no liability in respect of the Ocean and Sea Ice SAF products. EUMETSAT neither commits to nor guarantees the continuity, availability, or quality or suitability for any purpose of, the Ocean and Sea Ice SAF products.
history :
2023-03-20T12:29:37Z creation
date_created :
2023-03-20
cdm_data_type :
Grid
spatial_resolution :
25.0 km grid spacing
geospatial_bounds_crs :
EPSG:6931
product_version :
3.0
tracking_id :
2d0c7fd8-c092-4cff-9409-421010ba4167
naming_authority :
int.eumetsat
standard_name_vocabulary :
CF Standard Name Table (Version 78, 21 September 2021)
"
+ ]
+ },
+ {
+ "cell_type": "markdown",
+ "metadata": {},
+ "source": [
+ "## 5. Evaluation Metrics \n",
"\n",
"The term \"metric\" indicates a score or statistics that can represent a model's performance in reproducing observed features. A \"metric\" can be defined in many different ways, but the primary purpose of metrics is to summarize the performances of many different models and provide a framework for benchmarking model realism.\n",
"\n",
"In this notebook, we define **Mean Square Error (MSE)** and **Temporal MSE** as metrics.\n",
"\n",
- "### 4.1 Mean Square Error (Annual Mean)"
+ "### 5.1 Mean Square Error (Annual Mean) \n",
+ "\n",
+ "