Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Write output and restarts in a configurable directory path #1221

Open
aerorahul opened this issue Apr 23, 2024 · 5 comments
Open

Write output and restarts in a configurable directory path #1221

aerorahul opened this issue Apr 23, 2024 · 5 comments
Assignees
Labels
enhancement New feature or request

Comments

@aerorahul
Copy link

aerorahul commented Apr 23, 2024

Is your feature request related to a problem? Please describe.
NCEP/EE2 standards require restart capabilities for the forecast model.
After several discussions w/ NCEP Central Ops during the HAFSv3 implementation process, a run directory structure was co-developed. To enable/refine this restart feature, the model components would require to write their restarts and output to sub-directories instead of at the run directory root level.
Doing so has several advantages:

  • At long forecast hours, the output volume overwhelms the run directory and saving output in a component specific sub-directory will aid in better organizing data and diagnosing issues in the event of model failures
  • The workflows can redirect these output to a common path allowing restart capabilities from failure to continue.
  • WW3 output will be consistent w/ other components e.g. MOM6 and CICE6 that allow placing their output in similar sub-directories MOM6_OUTPUT/ and CICE_OUTPUT/. These paths are namelist controlled and the defaults are ./

Describe the solution you'd like
WW3 output and restarts are written out to WW3_OUTPUT/ and WW3_RESTART/ (or equivalent) subdirectories. The path to these subdirectories could be namelist configurable.

Describe alternatives you've considered
None that have all the advantages outlined in the feature request.

Additional context
A ticket for GFSv16 was opened during v16 implementation #219

@aerorahul aerorahul added the enhancement New feature or request label Apr 23, 2024
@BinLiu-NOAA
Copy link

@aerorahul Thanks for initial/creating this issue. This feature will be very useful for HAFS application/workflow (I am sure for other applications as well). Thanks!

@JessicaMeixner-NOAA
Copy link
Collaborator

Please note this work was already planned. The timeline for completion is 4-6 weeks.

@JessicaMeixner-NOAA
Copy link
Collaborator

@aerorahul any idea on how long of a directory file path length we should prepare for?

@aerorahul
Copy link
Author

@aerorahul any idea on how long of a directory file path length we should prepare for?

I would imagine a directory_path of 512 characters should be sufficient based on long usernames and typical partition paths that are seen on systems.
The filename could be different (based on the typical names of files in WW3).
The result: directory_path/filename
HTH's

@JessicaMeixner-NOAA
Copy link
Collaborator

Thanks @aerorahul I'll plan for that and we can adjust as needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Development

No branches or pull requests

3 participants