git clone https://github.com/roelstappers/Netatmo.jl.git Netatmo

edit Netatmo/src/config/config.json e.g. for PPI

{
    "CSV_ARCHIVE": "/lustre/storeB/users/<username>/Netatmo",
    "JSON_ARCHIVE": "/lustre/storeB/project/metproduction/products/netatmo/",
    "OBSOUL_ARCHIVE": "/lustre/storeB/users/roels/OBSOUL/"
}

To convert json files from /lustre/storeB/project/metproduction/products/netatmo/ to csv. Will only work at MET because of specifics in the JSON format.

julia --project scr/json2csv.jl

To convert csv to OBSOUL

julia --project scr/csv2obsoul.jl

For thinning we use the Hirlam/Domains.jl package

Current thinning distance is 20km

• Williams, Christopher KI, and Carl Edward Rasmussen. Gaussian processes for machine learning. Vol. 2. No. 3. Cambridge, MA: MIT Press, 2006.

• Bannister, Ross N. "A review of forecast error covariance statistics in atmospheric variational data assimilation. I: Characteristics and measurements of forecast error covariances." Quarterly Journal of the Royal Meteorological Society: A journal of the atmospheric sciences, applied meteorology and physical oceanography 134.637 (2008): 1951-1970.

• Daley, Roger. Atmospheric data analysis. No. 2. Cambridge university press, 1993.

• Fisher, Mike. "Background error covariance modelling." Seminar on Recent Development in Data Assimilation for Atmosphere and Ocean. 2003.

• Phillips, Norman A. "The spatial statistics of random geostrophic modes and first-guess errors." Tellus A: Dynamic Meteorology and Oceanography 38.4 (1986): 314-332.

• Hollingsworth, A. and Lönnberg, P. 1986. The statistical structure of short range forecast errors as determined from radiosonde data. Part I: The wind field. Tellus

• Lönnberg, P. and Hollingsworth, A. 1986. The statistical structure of short range forecast errors as determined from radiosonde data. Part 11: the covariance of height and wind errors. Tellus 38A, 137-161.

• Parrish, David F., and John C. Derber. "The National Meteorological Center's spectral statistical-interpolation analysis system." Monthly Weather Review 120.8 (1992): 1747-1763.

• Berre, Loïk. "Estimation of synoptic and mesoscale forecast error covariances in a limited-area model." Monthly weather review 128.3 (2000): 644-667.

• Eliassen,.1954. Provisional Report on Calculation of Spatial Covariance and Autocorrelation of the Pressure Field, Inst. Weather and Climate Res., Acad. Sci. Oslo, Rept. No. 5.

• Gaspari, Gregory, and Stephen E. Cohn. "Construction of correlation functions in two and three dimensions." Quarterly Journal of the Royal Meteorological Society 125.554 (1999): 723-757.

See Daley p117 for kernels for atmospheric DA.