Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PR for only record #949

Closed
wants to merge 82 commits into from
Closed
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
82 commits
Select commit Hold shift + click to select a range
8ae2c3f
test
lee1043 Nov 4, 2020
c2653b3
initial commit
acordonez Nov 4, 2020
19f1c2c
add .nojekyll
acordonez Nov 4, 2020
35c84e2
add rtd theme and other configs
acordonez Nov 4, 2020
3624fed
first pass at text
acordonez Nov 4, 2020
c75dcd0
move doc folder to docs
acordonez Nov 4, 2020
9cc98ba
add build
acordonez Nov 4, 2020
9ace150
move html to docs
acordonez Nov 4, 2020
8a9224d
stop tracking build
acordonez Nov 4, 2020
fc8358f
move html and doctrees
acordonez Nov 4, 2020
989844a
move .nojekyll
acordonez Nov 4, 2020
90b47de
add index
acordonez Nov 5, 2020
c22d749
remove this index
acordonez Nov 5, 2020
4524273
try moving html files to docs
acordonez Nov 5, 2020
a3a684d
remove doc folder
acordonez Nov 9, 2020
d01430a
move .nojekyll
acordonez Nov 9, 2020
9d2282b
Merge branch '648_jwl_documentation' of https://github.com/PCMDI/pcmd…
acordonez Nov 9, 2020
f2464f1
Merge branch '653_ao_newdocs' of https://github.com/acordonez/pcmdi_m…
acordonez Nov 10, 2020
4ca2af7
remove index.md
acordonez Nov 10, 2020
bd96e5a
simple change
gleckler1 Nov 12, 2020
5682adf
folder cleanup and add make github
acordonez Nov 12, 2020
2017754
Merge pull request #655 from acordonez/653_ao_docscleanup
gleckler1 Nov 12, 2020
5e3f7e6
add back obs_info_dictionary file for circleci
acordonez Nov 16, 2020
3379c3f
fix symbolic link
acordonez Nov 16, 2020
8e65f4f
fix symbolic link again
acordonez Nov 16, 2020
610fd98
replace /doc with /docs
acordonez Nov 16, 2020
08ded5a
Merge pull request #656 from PCMDI/653_ao_docs_obs
gleckler1 Nov 17, 2020
327a7ec
Merge pull request #654 from gleckler1/doc_test2_pjg
Nov 18, 2020
b8fd5fb
Add documentation instructions to readme
Nov 20, 2020
dcac299
Small formatting edits
Nov 20, 2020
56d56ab
a few more tests
gleckler1 Nov 24, 2020
c2b6e42
Merge pull request #657 from PCMDI/doc_test2_pjg
gleckler1 Nov 24, 2020
05003c1
still testing
gleckler1 Nov 24, 2020
f3c5b3e
Merge pull request #658 from PCMDI/doc_test2_pjg
gleckler1 Nov 24, 2020
af6857c
tech file added
gleckler1 Nov 24, 2020
7e2c875
Merge pull request #659 from PCMDI/doc_test2_pjg
gleckler1 Nov 24, 2020
0638c54
still learning
gleckler1 Nov 24, 2020
c04f560
still trying
gleckler1 Nov 24, 2020
a6818c3
Merge pull request #660 from PCMDI/doc_test2_pjg
gleckler1 Nov 24, 2020
4932aa0
starting tech intro
gleckler1 Nov 25, 2020
dfd6cac
Merge pull request #661 from PCMDI/doc_test2_pjg
gleckler1 Nov 25, 2020
086692d
only one install page now
gleckler1 Dec 1, 2020
68d20fd
adding new rst files
gleckler1 Dec 1, 2020
066ceae
Merge pull request #662 from PCMDI/doc_test2_pjg
gleckler1 Dec 1, 2020
4cd7db2
updating
gleckler1 Dec 24, 2020
488ece6
retesting
gleckler1 Dec 24, 2020
c5262b3
Merge pull request #666 from PCMDI/doc_test2_pjg
gleckler1 Dec 24, 2020
8e19d0e
back at it
gleckler1 Jan 14, 2021
5cc847f
Merge pull request #672 from PCMDI/doc_test2_pjg
gleckler1 Jan 14, 2021
318036c
minor index changes
gleckler1 Jan 15, 2021
c819c09
Merge pull request #673 from PCMDI/doc_test2_pjg
gleckler1 Jan 15, 2021
05cd461
another test
gleckler1 Jan 16, 2021
d091417
Merge pull request #674 from PCMDI/doc_test2_pjg
gleckler1 Jan 16, 2021
fe3d8f9
adding more bits
gleckler1 Jan 19, 2021
0db6ee0
Merge pull request #675 from PCMDI/doc_test2_pjg
gleckler1 Jan 19, 2021
e267bd6
added new htmls
gleckler1 Jan 19, 2021
bb26ee2
adding again1
gleckler1 Jan 19, 2021
de08f6b
adding again2
gleckler1 Jan 19, 2021
1c70565
updating index
gleckler1 Jan 20, 2021
8015e9e
Merge pull request #676 from PCMDI/doc_test2_pjg
gleckler1 Jan 20, 2021
adc9a41
minor doc updates
gleckler1 Jan 28, 2021
c280ccb
added old install
gleckler1 Jan 28, 2021
a73676e
working on downloads
gleckler1 Jan 29, 2021
0f06b19
updates on downloading data
gleckler1 Feb 1, 2021
e221764
Merge pull request #684 from PCMDI/doc_test2_pjg
gleckler1 Feb 1, 2021
1c49f1c
starting to work on mean climate
gleckler1 Feb 2, 2021
d30a8a2
Merge pull request #685 from PCMDI/doc_test2_pjg
gleckler1 Feb 2, 2021
9154e5a
added mean clim reqd params
gleckler1 Feb 2, 2021
49d62e6
Merge pull request #686 from PCMDI/doc_test2_pjg
gleckler1 Feb 2, 2021
54c325b
minor mean climate edits
gleckler1 Feb 4, 2021
fe608e8
disc of mean options
gleckler1 Feb 4, 2021
58e4de0
Get up-to-date master
gleckler1 Feb 9, 2021
763494d
intro to subdaily precip
gleckler1 Feb 11, 2021
aea1f25
Merge pull request #690 from PCMDI/doc_test2_pjg
gleckler1 Feb 11, 2021
fd2d5f3
mjo and monsoons
gleckler1 Mar 2, 2021
20345fa
Merge pull request #702 from PCMDI/doc_test2_pjg
gleckler1 Mar 2, 2021
fd75abb
fixing mjo
gleckler1 Mar 2, 2021
5e01f5e
Merge pull request #703 from PCMDI/doc_test2_pjg
gleckler1 Mar 2, 2021
484c8e2
pjg testing
Jan 26, 2022
68f5bd8
updating installation on doc pages
Jan 26, 2022
0ff8c48
install info improved
Jan 26, 2022
193e111
update to include mamba install and xcdat
lee1043 Apr 4, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
minor mean climate edits
  • Loading branch information
gleckler1 committed Feb 4, 2021
commit 54c325b991cf31dd269915bd7ecd6169454e01ba
33 changes: 19 additions & 14 deletions docs/_sources/mean-climate.rst.txt
Original file line number Diff line number Diff line change
Expand Up @@ -9,18 +9,24 @@ Overview

The mean climate summary statistics are some of the most routine analysis available from the PMP. At the same time, because of the number of options available they do require some preparation in advance of the analysis, including:

* Setting observational climatologies
* Setting-up observational climatologies

* Preparation of model climatologies

* Construction of an input parameter file


Each of these steps are included in the `mean climate notebook <https://github.com/PCMDI/pcmdi_metrics/blob/master/doc/jupyter/Demo/Demo_1_mean_climate.ipynb>`_ along with a series of examples that demonstrate the options. These steps are also summarized below.


Observational climatologies
###########################

A database of `observational climatologies <https://github.com/PCMDI/PCMDIobs-cmor-tables/blob/master/catalogue/pcmdiobs2_clims_byVar_catalogue_v20201210.json>`_ is available to users of the PMP. To obtain this, please contact the PMP user group ([email protected]) and you will be promptly provided with the database. A subset of this database is available via the demo data made available for the PMP tutorials via a `jupyter notebook demo <https://github.com/PCMDI/pcmdi_metrics/blob/master/doc/jupyter/Demo/Demo_0_download_data.ipynb>`_. Once you have downloaded this demo data you can interactively run the mean climate and other demos.
A database of `observational climatologies is available to users of the PMP. To obtain this, please contact the PMP user group ([email protected]) and you will be promptly provided with the database. A subset of this database is available via the demo data made available for the PMP tutorials via a `jupyter notebook demo <https://github.com/PCMDI/pcmdi_metrics/blob/master/doc/jupyter/Demo/Demo_0_download_data.ipynb>`_. Once you have downloaded this demo data you can interactively run the mean climate and other demos.

The PMP's mean climate summary statistics can be applied many fields and in most cases there is more than one reference data set available. To accomodate this, as noted above the observational climatologies used by the PMP are managed via `a simple catalogue in the form of a JSON file <https://github.com/PCMDI/pcmdi_metrics/blob/master/doc/pcmdiobs2_clims_byVar_catalogue_v20201210.json>`_. For many of the variables there are 'default' and 'alternate1' datasets and for some there is also an 'alternate2'. Note: To simplify the use of the different options in the mean climate, the mean_climate_driver.py (see below) expects to be pointed to such a JSON file that summarizes the database. Currently, if a user wants to add additional observational data this can be done by including it in the JSON cataloge. Note: this most be done carefully to ensure the file retains compliant JSON structure.


The `mean climate notebook <https://github.com/PCMDI/pcmdi_metrics/blob/master/doc/jupyter/Demo/Demo_1_mean_climate.ipynb>`_ provides a series of examples that demonstrate the options available.

Preparation of model climatologies
##################################
Expand All @@ -40,24 +46,23 @@ or as a combination of an input parameter file and the command line, e.g.: ::

mean_climate_driver.py -p basic_param.py --vars rlut pr

where the list of variables to run the analysis on includes the variables 'rlut' (outgoing TOA longwave radiation) and 'pr' (precipitation). The following parameters need to be set by the user either in a parameter file or on the command line:
where the list of variables (vars) to run the analysis on includes 'rlut' (outgoing TOA longwave radiation) and 'pr' (precipitation). The following parameters need to be set by the user either in a parameter file or on the command line:

* test_data_set
* vars
* reference_data_set
* target_grid
* regrid_tool
* filename_template
* test_data_path
* reference_data_path
* metric_output_path
* **vars**: a python list of variables to apply the summary statistics, e.g., ['pr', 'rlut', 'tas']
* **test_data_set**: a python list of runs or models, e.g., ['ACCESS-1-0', 'CESM1']
* **filename_template**: template that is applicable for the runs in test_data_set, e.g., "CMIP5.historical.%(model_version).r1i1p1.mon.%(variable).198101-200512.AC.v20190225.nc" where "model_version" and "variable" will include the lists in test_data_set and vars.
* **test_data_path**: the path/template where the test_data resides, e.g.:
* **reference_data_set**: a python list that specifies 'default', 'alternate1', 'alternate2' or 'all', e.g., ['default']
* **reference_data_path**: the root path to the PMP climatology database
* **target_grid**:
* **regrid_tool**: options include
* **metric_output_path**:

The output of the mean climate summary statistics are saved in a JSON file. `An example result <https://github.com/PCMDI/pcmdi_metrics/blob/master/sample_setups/jsons/mean_climate/CMIP5/historical/v20190724/tas/ACCESS1-0.tas.CMIP5.historical.regrid2.2p5x2p5.v20190724.json>`_ demonstrates that multiple statistics are computed for different conditions including regions and seasons. The resulting JSON files include the data, software and hardware information on how the summary statistics.


In addition to the minimum set of parameters noted above, the following additional options than can be controlled for the mean climate:

* Select regridding method option
* Define a different set of regions to compute the statistics.
* Provide or estimate a land-sea mask
* Define regional masking (e.g., global land-only, global ocean-only,tropical land)
Expand Down
28 changes: 14 additions & 14 deletions docs/mean-climate.html
Original file line number Diff line number Diff line change
Expand Up @@ -174,14 +174,15 @@
<h2>Overview<a class="headerlink" href="#overview" title="Permalink to this headline">¶</a></h2>
<p>The mean climate summary statistics are some of the most routine analysis available from the PMP. At the same time, because of the number of options available they do require some preparation in advance of the analysis, including:</p>
<ul class="simple">
<li><p>Setting observational climatologies</p></li>
<li><p>Setting-up observational climatologies</p></li>
<li><p>Preparation of model climatologies</p></li>
<li><p>Construction of an input parameter file</p></li>
</ul>
<p>Each of these steps are included in the <a class="reference external" href="https://github.com/PCMDI/pcmdi_metrics/blob/master/doc/jupyter/Demo/Demo_1_mean_climate.ipynb">mean climate notebook</a> along with a series of examples that demonstrate the options. These steps are also summarized below.</p>
<div class="section" id="observational-climatologies">
<h3>Observational climatologies<a class="headerlink" href="#observational-climatologies" title="Permalink to this headline">¶</a></h3>
<p>A database of <a class="reference external" href="https://github.com/PCMDI/PCMDIobs-cmor-tables/blob/master/catalogue/pcmdiobs2_clims_byVar_catalogue_v20201210.json">observational climatologies</a> is available to users of the PMP. To obtain this, please contact the PMP user group (<a class="reference external" href="mailto:pcmdi-metrics&#37;&#52;&#48;llnl&#46;gov">pcmdi-metrics<span>&#64;</span>llnl<span>&#46;</span>gov</a>) and you will be promptly provided with the database. A subset of this database is available via the demo data made available for the PMP tutorials via a <a class="reference external" href="https://github.com/PCMDI/pcmdi_metrics/blob/master/doc/jupyter/Demo/Demo_0_download_data.ipynb">jupyter notebook demo</a>. Once you have downloaded this demo data you can interactively run the mean climate and other demos.</p>
<p>The <a class="reference external" href="https://github.com/PCMDI/pcmdi_metrics/blob/master/doc/jupyter/Demo/Demo_1_mean_climate.ipynb">mean climate notebook</a> provides a series of examples that demonstrate the options available.</p>
<p>A database of <a class="reference external" href="https://github.com/PCMDI/pcmdi_metrics/blob/master/doc/jupyter/Demo/Demo_0_download_data.ipynb">observational climatologies is available to users of the PMP. To obtain this, please contact the PMP user group (pcmdi-metrics&#64;llnl.gov) and you will be promptly provided with the database. A subset of this database is available via the demo data made available for the PMP tutorials via a `jupyter notebook demo</a>. Once you have downloaded this demo data you can interactively run the mean climate and other demos.</p>
<p>The PMP’s mean climate summary statistics can be applied many fields and in most cases there is more than one reference data set available. To accomodate this, as noted above the observational climatologies used by the PMP are managed via <a class="reference external" href="https://github.com/PCMDI/pcmdi_metrics/blob/master/doc/pcmdiobs2_clims_byVar_catalogue_v20201210.json">a simple catalogue in the form of a JSON file</a>. For many of the variables there are ‘default’ and ‘alternate1’ datasets and for some there is also an ‘alternate2’. Note: To simplify the use of the different options in the mean climate, the mean_climate_driver.py (see below) expects to be pointed to such a JSON file that summarizes the database. Currently, if a user wants to add additional observational data this can be done by including it in the JSON cataloge. Note: this most be done carefully to ensure the file retains compliant JSON structure.</p>
</div>
<div class="section" id="preparation-of-model-climatologies">
<h3>Preparation of model climatologies<a class="headerlink" href="#preparation-of-model-climatologies" title="Permalink to this headline">¶</a></h3>
Expand All @@ -197,22 +198,21 @@ <h3>Construction of an input paramater file<a class="headerlink" href="#construc
<div class="highlight-default notranslate"><div class="highlight"><pre><span></span><span class="n">mean_climate_driver</span><span class="o">.</span><span class="n">py</span> <span class="o">-</span><span class="n">p</span> <span class="n">basic_param</span><span class="o">.</span><span class="n">py</span> <span class="o">--</span><span class="nb">vars</span> <span class="n">rlut</span> <span class="n">pr</span>
</pre></div>
</div>
<p>where the list of variables to run the analysis on includes the variables ‘rlut’ (outgoing TOA longwave radiation) and ‘pr’ (precipitation). The following parameters need to be set by the user either in a parameter file or on the command line:</p>
<p>where the list of variables (vars) to run the analysis on includes ‘rlut’ (outgoing TOA longwave radiation) and ‘pr’ (precipitation). The following parameters need to be set by the user either in a parameter file or on the command line:</p>
<ul class="simple">
<li><p>test_data_set</p></li>
<li><p>vars</p></li>
<li><p>reference_data_set</p></li>
<li><p>target_grid</p></li>
<li><p>regrid_tool</p></li>
<li><p>filename_template</p></li>
<li><p>test_data_path</p></li>
<li><p>reference_data_path</p></li>
<li><p>metric_output_path</p></li>
<li><p><strong>vars</strong>: a python list of variables to apply the summary statistics, e.g., [‘pr’, ‘rlut’, ‘tas’]</p></li>
<li><p><strong>test_data_set</strong>: a python list of runs or models, e.g., [‘ACCESS-1-0’, ‘CESM1’]</p></li>
<li><p><strong>filename_template</strong>: template that is applicable for the runs in test_data_set, e.g., “CMIP5.historical.%(model_version).r1i1p1.mon.%(variable).198101-200512.AC.v20190225.nc” where “model_version” and “variable” will include the lists in test_data_set and vars.</p></li>
<li><p><strong>test_data_path</strong>: the path/template where the test_data resides, e.g.:</p></li>
<li><p><strong>reference_data_set</strong>: a python list that specifies ‘default’, ‘alternate1’, ‘alternate2’ or ‘all’, e.g., [‘default’]</p></li>
<li><p><strong>reference_data_path</strong>: the root path to the PMP climatology database</p></li>
<li><p><strong>target_grid</strong>:</p></li>
<li><p><strong>regrid_tool</strong>: options include</p></li>
<li><p><strong>metric_output_path</strong>:</p></li>
</ul>
<p>The output of the mean climate summary statistics are saved in a JSON file. <a class="reference external" href="https://github.com/PCMDI/pcmdi_metrics/blob/master/sample_setups/jsons/mean_climate/CMIP5/historical/v20190724/tas/ACCESS1-0.tas.CMIP5.historical.regrid2.2p5x2p5.v20190724.json">An example result</a> demonstrates that multiple statistics are computed for different conditions including regions and seasons. The resulting JSON files include the data, software and hardware information on how the summary statistics.</p>
<p>In addition to the minimum set of parameters noted above, the following additional options than can be controlled for the mean climate:</p>
<ul class="simple">
<li><p>Select regridding method option</p></li>
<li><p>Define a different set of regions to compute the statistics.</p></li>
<li><p>Provide or estimate a land-sea mask</p></li>
<li><p>Define regional masking (e.g., global land-only, global ocean-only,tropical land)</p></li>
Expand Down
Loading