Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[develop]: Document process for changing number of vertical levels #888

Merged
merged 148 commits into from
Sep 6, 2023
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
148 commits
Select commit Hold shift + click to select a range
ff80851
update FAQ
gspetro-NOAA Jul 5, 2023
82b2e52
split up/revise Intro; reorg chapters
gspetro-NOAA Jul 5, 2023
b905241
update components section; also monor updates to intro, tech ov, glos…
gspetro-NOAA Jul 5, 2023
fd9efc8
restructure SRW docs
gspetro-NOAA Jul 6, 2023
438814f
finish restructuring, rm images
gspetro-NOAA Jul 6, 2023
a74f4d4
minor updates
gspetro-NOAA Jul 6, 2023
e778e1b
edit tables, add component info
gspetro-NOAA Jul 6, 2023
c2a772a
add info on components
gspetro-NOAA Jul 7, 2023
48e6038
rename Tech Details section
gspetro-NOAA Jul 7, 2023
57c8b08
edit build chapter
gspetro-NOAA Jul 7, 2023
d8e3c30
add cpld_gridgen def
gspetro-NOAA Jul 10, 2023
de60461
rename/reorganize/minor fixes
gspetro-NOAA Jul 10, 2023
1cfba00
minor updates
gspetro-NOAA Jul 10, 2023
593c4c6
minor updates
gspetro-NOAA Jul 10, 2023
e4ba1bc
change regional_workflow to workflow_tools
gspetro-NOAA Jul 10, 2023
e5df5c0
change regional workflow to workflow or SRW App workflow
gspetro-NOAA Jul 10, 2023
92dd46d
update info on loading wflow env for L1 v L2-4 systems
gspetro-NOAA Jul 10, 2023
0a1e7a2
move config_defaults table out of Run chapter
gspetro-NOAA Jul 10, 2023
36b2901
update run ch & tables
gspetro-NOAA Jul 12, 2023
fdf7ed2
config section updates/reorg
gspetro-NOAA Jul 12, 2023
ffc7f86
minor run updates
gspetro-NOAA Jul 12, 2023
0729d1b
plotting & VX updates
gspetro-NOAA Jul 12, 2023
9237772
minor updates
gspetro-NOAA Jul 13, 2023
1860238
add info about NCO-compliant structure
gspetro-NOAA Jul 13, 2023
b88cf59
update wflow & VX task tables
gspetro-NOAA Jul 13, 2023
db20aa9
update VX task table w/ensemble info
gspetro-NOAA Jul 17, 2023
2adb67b
add slides for Purser ESG grid
gspetro-NOAA Jul 17, 2023
552d57b
RunSRW edits
gspetro-NOAA Jul 17, 2023
8f976cf
some QS updates
gspetro-NOAA Jul 17, 2023
43fa966
First set of updates in RunSRW.rst
mkavulich Jul 19, 2023
e6fca92
More updates for PR 864
mkavulich Jul 19, 2023
07ee7a5
'GET_OBS' isn't a valid config.yaml variable
mkavulich Jul 19, 2023
27095ed
Add section links for more information
mkavulich Jul 19, 2023
f13fec5
Better description of MRMS data staging script
mkavulich Jul 19, 2023
c074431
Merge pull request #1 from mkavulich/PR_864_doc_updates
gspetro-NOAA Jul 20, 2023
5a2c266
Merge branch 'ufs-community:develop' into text/ug-updates
gspetro-NOAA Jul 20, 2023
f0656eb
minor formatting
gspetro-NOAA Jul 21, 2023
519a427
add details on AQM executables & tasks
gspetro-NOAA Jul 29, 2023
78d7c6d
minor Tutorial & QS updates
gspetro-NOAA Jul 29, 2023
2bbc3ac
update AQM section
gspetro-NOAA Aug 1, 2023
79e9dbd
formatting fixes
gspetro-NOAA Aug 1, 2023
0b9547a
minor fixes
gspetro-NOAA Aug 1, 2023
4b323de
add AQM expt data info & wflow SUCCESS info
gspetro-NOAA Aug 2, 2023
f004d1f
minor WE2E updates
gspetro-NOAA Aug 2, 2023
2fe0f99
update testing ch
gspetro-NOAA Aug 3, 2023
c52ee61
reorganize WE2E, condense
gspetro-NOAA Aug 4, 2023
911ffdc
WE2E edits
gspetro-NOAA Aug 4, 2023
d74a1d1
update Container QS
gspetro-NOAA Aug 4, 2023
6865890
update VX cases ch
gspetro-NOAA Aug 4, 2023
5f0bcf5
update Tutorial
gspetro-NOAA Aug 4, 2023
9374a3e
update 1st half of FAQ
gspetro-NOAA Aug 4, 2023
b3e1c5f
update FAQ
gspetro-NOAA Aug 7, 2023
7570503
add comma
gspetro-NOAA Aug 7, 2023
f23e441
update Rocoto ch & minor details in other chs
gspetro-NOAA Aug 7, 2023
188a149
rename Tech Deteails ch
gspetro-NOAA Aug 7, 2023
e1ef957
update index file w/new dir names
gspetro-NOAA Aug 7, 2023
7c5818d
add ufs wm intersphinx
gspetro-NOAA Aug 8, 2023
3c2c727
I/O updates
gspetro-NOAA Aug 8, 2023
9806215
update file /path/to convention
gspetro-NOAA Aug 8, 2023
995ccf2
update file /path/to convention
gspetro-NOAA Aug 8, 2023
67c17af
update I/O ch
gspetro-NOAA Aug 8, 2023
b917456
resolve merge conflict from develop
gspetro-NOAA Aug 8, 2023
351141a
add FAQ update & link update
gspetro-NOAA Aug 8, 2023
bf48e21
Defining Wflow updates
gspetro-NOAA Aug 8, 2023
c3e0ba0
Defining Wflow updates
gspetro-NOAA Aug 9, 2023
f6d0b9b
Intro updates
gspetro-NOAA Aug 9, 2023
a8335a1
Intro updates
gspetro-NOAA Aug 9, 2023
a8f0b81
minor details
gspetro-NOAA Aug 10, 2023
6d30954
fix typo
gspetro-NOAA Aug 10, 2023
49c42af
resolve merge conflicts, add AQM data info
gspetro-NOAA Aug 10, 2023
d41c56f
add initial vertical level/layer section info
gspetro-NOAA Aug 10, 2023
0ea850a
revert changes to align w/v2.1.0 stable code
gspetro-NOAA Aug 10, 2023
ab6d093
add prdgen def
gspetro-NOAA Aug 11, 2023
1732415
minor edits
gspetro-NOAA Aug 11, 2023
df63c9d
1st draft vertical coordinates
gspetro-NOAA Aug 11, 2023
01ad8a3
Merge branch 'text/ug-updates' into text/grid
gspetro-NOAA Aug 11, 2023
d48deb3
fix #levels
gspetro-NOAA Aug 11, 2023
390da60
add more ak/bk gen info
gspetro-NOAA Aug 14, 2023
7f07032
minor updates
gspetro-NOAA Aug 14, 2023
fb7be06
minor fixes
gspetro-NOAA Aug 14, 2023
80b265e
minor updates
gspetro-NOAA Aug 14, 2023
95f7179
rm mention of any required file structure for *_OBS_DIR paths
gspetro-NOAA Aug 14, 2023
e16cdae
update to 5 supported physics suites
gspetro-NOAA Aug 15, 2023
e7efb8f
fix off-by-one error
gspetro-NOAA Aug 15, 2023
801465c
minor edits
gspetro-NOAA Aug 15, 2023
a686045
rm mentions of GSI/rrfs-utl
gspetro-NOAA Aug 15, 2023
ed4faf6
rework instructions to use pre-built vcoord_gen executable
gspetro-NOAA Aug 15, 2023
1f485d6
Merge branch 'ufs-community:develop' into text/grid
gspetro-NOAA Aug 16, 2023
ef77903
Merge branch 'ufs-community:develop' into text/ug-updates
gspetro-NOAA Aug 16, 2023
36b338f
Updates to WE2E tests
mkavulich Aug 16, 2023
7df67d5
Update WE2E testing doc umentation
mkavulich Aug 16, 2023
9aaafc4
fix typos/formatting
gspetro-NOAA Aug 16, 2023
51d7350
update # of CCPP suites
gspetro-NOAA Aug 16, 2023
6b11b2b
update table of comm config vals
gspetro-NOAA Aug 17, 2023
3084869
Add task_get_obs_nohrsc to VX tasks table
gspetro-NOAA Aug 17, 2023
b7c917b
Fix VX task name: metatask_PcpCombine_fcst_APCP_all_accums_all_mems
gspetro-NOAA Aug 17, 2023
8684019
Add VX task to table: metatask_PcpCombine_fcst_ASNOW_all_accums_all_mems
gspetro-NOAA Aug 17, 2023
fd0f849
Add VX task to table: metatask_GenEnsProd_EnsembleStat_NOHRSC
gspetro-NOAA Aug 17, 2023
389ab11
Fix VX task table: metatask_GridStat_NOHRSC_ensmeanprob_all_accums
gspetro-NOAA Aug 17, 2023
e2138b3
rm GSI from Glossary
gspetro-NOAA Aug 17, 2023
dcbd4c2
Merge branch 'text/ug-updates' of github.com:gspetro-NOAA/ufs-srweath…
gspetro-NOAA Aug 17, 2023
15eb7ae
fix typo
gspetro-NOAA Aug 17, 2023
c18f2b5
minor edits
gspetro-NOAA Aug 17, 2023
f4b7be8
Merge branch 'text/ug-updates' of github.com:gspetro-NOAA/ufs-srweath…
gspetro-NOAA Aug 17, 2023
7296127
Merge branch 'ufs-community:develop' into text/ug-updates
gspetro-NOAA Aug 21, 2023
c178e8f
Merge branch 'ufs-community:develop' into text/grid
gspetro-NOAA Aug 23, 2023
c1d250c
update to head of develop
gspetro-NOAA Aug 25, 2023
406693a
Merge branch 'text/ug-updates' of github.com:gspetro-NOAA/ufs-srweath…
gspetro-NOAA Aug 25, 2023
a242b3b
Update RRFS mention in Intro
gspetro-NOAA Aug 25, 2023
6403974
minor cholt edits
gspetro-NOAA Aug 25, 2023
a24e663
update I/O NOMADS mention to S3 bucket
gspetro-NOAA Aug 25, 2023
40c794b
remove stray Run ch from PR 883 & fix table formatting
gspetro-NOAA Aug 25, 2023
79ef602
Update 18h to 18 UTC
gspetro-NOAA Aug 25, 2023
82202e1
rm stray RRFS/gsi mentions
gspetro-NOAA Aug 25, 2023
9f1aa91
Merge branch 'text/ug-updates' of github.com:gspetro-NOAA/ufs-srweath…
gspetro-NOAA Aug 25, 2023
0eba803
expand list of supported components
gspetro-NOAA Aug 25, 2023
5a8eb8d
update notes in Container ch
gspetro-NOAA Aug 25, 2023
1c8c3b9
QS and container QS updates
gspetro-NOAA Aug 25, 2023
0d0257d
rm package list; add uwtools env instructions
gspetro-NOAA Aug 25, 2023
31cc9ef
clarify re EXPTDIR
gspetro-NOAA Aug 28, 2023
629186b
rm confusing csh ref
gspetro-NOAA Aug 28, 2023
4713c3e
clarify bash/csh env commands
gspetro-NOAA Aug 28, 2023
9837c97
minor fixes
gspetro-NOAA Aug 29, 2023
1a84595
Update RunSRW to rm $PWD in config_utils cmd
gspetro-NOAA Aug 29, 2023
e606bda
Update Intro QS Description
gspetro-NOAA Aug 29, 2023
109b88c
Update CQS crosslink
gspetro-NOAA Aug 29, 2023
a6fb29d
Update instructions on providing error msg
gspetro-NOAA Aug 29, 2023
92aea33
update software prereqs
gspetro-NOAA Aug 29, 2023
edb8531
update ESMF SCRIP abbrev
gspetro-NOAA Aug 29, 2023
d0c8ee1
link to j-jobs in glossary
gspetro-NOAA Aug 29, 2023
0d95dcc
update instructions on filing GitHub issues
gspetro-NOAA Aug 29, 2023
705ea15
Update Intro info on QS
gspetro-NOAA Aug 29, 2023
3823a3c
rm redundant umbrella repo def
gspetro-NOAA Aug 29, 2023
d8c8407
Merge branch 'text/ug-updates' of github.com:gspetro-NOAA/ufs-srweath…
gspetro-NOAA Aug 29, 2023
1201e24
Update intro w/user support recs
gspetro-NOAA Aug 29, 2023
09e10ca
rm note re container binding on Jet
gspetro-NOAA Aug 29, 2023
62e54eb
Merge branch 'text/ug-updates' of github.com:gspetro-NOAA/ufs-srweath…
gspetro-NOAA Aug 29, 2023
4261f08
Update container docs w/Apptainer info
gspetro-NOAA Aug 29, 2023
6e55e60
fix j-job xref
gspetro-NOAA Aug 29, 2023
a4ca1d0
fix link
gspetro-NOAA Aug 29, 2023
61515b8
Change name of Ch 3 to 'Customizing the Workflow'
gspetro-NOAA Aug 30, 2023
5b045a0
Update CQS ch w/Gaea c5 info
gspetro-NOAA Aug 30, 2023
653fe01
rename to Customizing the Workflow
gspetro-NOAA Aug 30, 2023
4f6ae16
update link to ccpp sci docs
gspetro-NOAA Aug 30, 2023
ad35c2a
resolve conflicts
gspetro-NOAA Aug 30, 2023
30ab75a
Merge branch 'text/grid' of github.com:gspetro-NOAA/ufs-srweather-app…
gspetro-NOAA Aug 30, 2023
7c62989
Merge branch 'develop' into text/grid
gspetro-NOAA Aug 30, 2023
78204be
Jeff's updates
gspetro-NOAA Sep 1, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
restructure SRW docs
  • Loading branch information
gspetro-NOAA committed Jul 6, 2023
commit fd9efc82b8a17b9d9810bdc0264d75532687e15d
119 changes: 119 additions & 0 deletions docs/UsersGuide/source/BackgroundInformation/Components.rst

Large diffs are not rendered by default.

150 changes: 150 additions & 0 deletions docs/UsersGuide/source/BackgroundInformation/Introduction.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,150 @@
.. _Introduction:

==============
Introduction
==============

The Unified Forecast System (:term:`UFS`) is a community-based, coupled, comprehensive Earth modeling system. NOAA's operational model suite for numerical weather prediction (:term:`NWP`) is quickly transitioning to the UFS from a number of different modeling systems. The UFS enables research, development, and contribution opportunities within the broader :term:`Weather Enterprise` (including government, industry, and academia). For more information about the UFS, visit the `UFS Portal <https://ufscommunity.org/>`__.

The UFS includes `multiple applications <https://ufscommunity.org/science/aboutapps/>`__ that support different forecast durations and spatial domains. This documentation describes the UFS Short-Range Weather (SRW) Application, which targets predictions of atmospheric behavior on a limited spatial domain and on time scales from minutes to several days. The most recent SRW Application includes a prognostic atmospheric model, pre- and post-processing, and a community workflow for running the system end-to-end. These components are documented within this User's Guide and supported through the `GitHub Discussions <https://github.com/ufs-community/ufs-srweather-app/discussions/categories/q-a>`__ forum. The SRW App also includes support for a verification package (METplus) for both deterministic and ensemble simulations and support for four stochastically perturbed physics schemes.

Since the v2.1.0 release, developers have added a variety of features:

* Bug fixes since the v2.1.0 release
* Rapid Refresh Forecast System (RRFS) capabilities
* Air Quality Modeling (AQM) capabilities
* Updates to :term:`CCPP` that target the top of the ``main`` branch (which is ahead of CCPP v6.0.0). See :ref:`this page <CCPPUpdates>` for a detailed summary of updates that came in ahead of the v2.1.0 release.
* Support for the :term:`UPP` inline post option (see :ref:`here <InlinePost>`)
* Documentation updates to reflect the changes above

The SRW App v2.1.0 citation is as follows and should be used when presenting results based on research conducted with the App:

UFS Development Team. (2022, Nov. 17). Unified Forecast System (UFS) Short-Range Weather (SRW) Application (Version v2.1.0). Zenodo. https://doi.org/10.5281/zenodo.7277602

Organization of SRW App Documentation
========================================

The SRW Application documentation is organized into four sections: *Background Information*; *Building, Running, and Testing the SRW App*; *Technical Information*; and *Reference*.

.. hint::
* To get started with the SRW App, users can try one of the following options:

#. View :numref:`Chapter %s <NCQuickstart>` for a quick overview of the workflow steps.
#. To build the application in a container, which provides a more uniform work environment, users can refer to the :ref:`Container-Based Quick Start Guide <QuickstartC>`.
#. For detailed instructions on building and running the SRW App, users can refer to :numref:`Chapter %s: Building the SRW App <BuildSRW>` and :numref:`Chapter %s: Running the SRW App <RunSRW>`.

Background Information
------------------------

* This **Introduction** chapter explains how the SRW App documentation is organized, how to use this guide, and where to find user support/documentation.
* :numref:`Chapter %s: Technical Overview <TechOverview>` provides a technical overview, including SRW App prerequisites, code overview/directory structure, and summary of components.
* :numref:`Chapter %s: Components <Components>` provides a more detailed description of the application components, including optional application components.

Building, Running, and Testing the SRW App
--------------------------------------------

* :numref:`Chapter %s: Quick Start Guide <NCQuickstart>` is designed for use on `Level 1 systems <https://github.com/ufs-community/ufs-srweather-app/wiki/Supported-Platforms-and-Compilers>`__ or as an overview of the workflow.
* :numref:`Chapter %s: Container-Based Quick Start Guide <QuickstartC>` explains how to run the SRW Application in a container. Containers come with SRW App prerequisites already installed and run on a broad range of systems.
* :numref:`Chapter %s: Building the SRW App <BuildSRW>` provides a *detailed* explanation of how to build the SRW App.
* :numref:`Chapter %s: Running the SRW App <RunSRW>` provides a *detailed* explanation of how to run the App after it has been built. It includes information on standard workflow tasks, additional optional tasks (e.g., METplus verification, plotting), and different techniques for running the workflow.
* :numref:`Chapter %s: Tutorials <Tutorial>` walks users through different SRW App experiment cases and analysis of results.
* :numref:`Chapter %s: <WE2E_tests>` explains how to run workflow end-to-end tests to ensure that new developments do not break the current workflow.
* :numref:`Chapter %s: <VXCases>` explains how to run METplus verification as part of the workflow.
* :numref:`Chapter %s: Air Quality Modeling <AQM>` provides information specific to air quality modeling (AQM). This feature is currently unsupported, so documentation may be behind the current state of development, which is progressing rapidly. However, this chapter is a starting point for those interested in AQM.

Technical Information for Users
---------------------------------

* :numref:`Chapter %s: <ConfigWorkflow>` documents all of the user-configurable experiment parameters that can be set in ``config.yaml``.
* :numref:`Chapter %s: <InputOutputFiles>` provides information on application input and output files, as well as information on where to get publicly available data.
* :numref:`Chapter %s: <LAMGrids>` describes the SRW App predefined grids in detail and explains how to create a custom user-generated grid.
* :numref:`Chapter %s: <DefineWorkflow>` explains how to build or alter the SRW App workflow XML file.
* :numref:`Chapter %s: <TemplateVars>` explains how to use template variables.

Reference Information
-----------------------

* :numref:`Chapter %s: Rocoto Introductory Information <RocotoInfo>` provides an introduction to standard Rocoto commands with examples.
* :numref:`Chapter %s: FAQ <FAQ>` answers users' frequently asked questions.
* :numref:`Chapter %s: Glossary <Glossary>` defines important terms related to the SRW App.


How to Use This Document
========================

This guide instructs both novice and experienced users on downloading, building, and running the SRW Application. Please post questions in the `GitHub Discussions <https://github.com/ufs-community/ufs-srweather-app/discussions>`__ forum.

.. code-block:: console

Throughout the guide, this presentation style indicates shell commands and options, code examples, etc.

Variables presented as ``AaBbCc123`` in this User's Guide typically refer to variables in scripts, names of files, or directories.

File paths and code that include angle brackets (e.g., ``build_<platform>_<compiler>``) indicate that users should insert options appropriate to their SRW App configuration (e.g., ``build_orion_intel``).

User Support, Documentation, and Contributions to Development
===============================================================

The SRW App's `GitHub Discussions <https://github.com/ufs-community/ufs-srweather-app/discussions/categories/q-a>`__ forum provides online support for UFS users and developers to post questions and exchange information.

A list of available documentation is shown in :numref:`Table %s <list_of_documentation>`.

.. _list_of_documentation:

.. table:: Centralized list of documentation

+----------------------------+---------------------------------------------------------------------------------+
| **Documentation** | **Location** |
+============================+=================================================================================+
| UFS SRW Application | https://ufs-srweather-app.readthedocs.io/en/develop/ |
| User's Guide | |
+----------------------------+---------------------------------------------------------------------------------+
| UFS_UTILS Technical | https://noaa-emcufs-utils.readthedocs.io/en/latest |
| Documentation | |
+----------------------------+---------------------------------------------------------------------------------+
| UFS_UTILS Scientific | https://ufs-community.github.io/UFS_UTILS/index.html |
| Documentation | |
+----------------------------+---------------------------------------------------------------------------------+
| UFS Weather Model | https://ufs-weather-model.readthedocs.io/en/latest |
| User's Guide | |
+----------------------------+---------------------------------------------------------------------------------+
| HPC-Stack Documentation | https://hpc-stack.readthedocs.io/en/latest/ |
+----------------------------+---------------------------------------------------------------------------------+
| FV3 Scientific | https://repository.library.noaa.gov/view/noaa/30725 |
| Documentation | |
+----------------------------+---------------------------------------------------------------------------------+
| FV3 Technical | https://noaa-emc.github.io/FV3_Dycore_ufs-v2.0.0/html/index.html |
| Documentation | |
+----------------------------+---------------------------------------------------------------------------------+
| CCPP Scientific | https://dtcenter.ucar.edu/GMTB/v6.0.0/sci_doc/index.html |
| Documentation | |
+----------------------------+---------------------------------------------------------------------------------+
| CCPP Technical | https://ccpp-techdoc.readthedocs.io/en/latest/ |
| Documentation | |
+----------------------------+---------------------------------------------------------------------------------+
| Stochastic Physics | https://stochastic-physics.readthedocs.io/en/latest/ |
| Documentation | |
+----------------------------+---------------------------------------------------------------------------------+
| ESMF manual | https://earthsystemmodeling.org/docs/release/latest/ESMF_usrdoc/ |
+----------------------------+---------------------------------------------------------------------------------+
| Unified Post Processor | https://upp.readthedocs.io/en/latest/ |
+----------------------------+---------------------------------------------------------------------------------+

The UFS community is encouraged to contribute to the development effort of all related
utilities, model code, and infrastructure. Users can post issues in the related GitHub repositories to report bugs or to announce upcoming contributions to the code base. For code to be accepted into the authoritative repositories, users must follow the code management rules of each UFS component repository. These rules are usually outlined in the User's Guide (see :numref:`Table %s <list_of_documentation>`) or wiki for each respective repository (see :numref:`Table %s <top_level_repos>`). Contributions to the `ufs-srweather-app <https://github.com/ufs-community/ufs-srweather-app>`__ repository should follow the guidelines contained in the `SRW App Contributor's Guide <https://github.com/ufs-community/ufs-srweather-app/wiki/Contributor's-Guide>`__.

Future Direction
=================

Users can expect to see incremental improvements and additional capabilities in upcoming releases of the SRW Application to enhance research opportunities and support operational forecast implementations. Planned enhancements include:

* A more extensive set of supported developmental physics suites.
* A larger number of pre-defined domains/resolutions and a *fully supported* capability to create a user-defined domain.
* Add user-defined vertical levels (number and distribution).
* Inclusion of data assimilation and forecast restart/cycling capabilities.


.. bibliography:: ../references.bib



Loading