Skip to content
This repository has been archived by the owner on Sep 1, 2022. It is now read-only.

Empty reply from ncss dataset page for NetCDF files #1016

Closed
ghost opened this issue Jan 29, 2018 · 5 comments
Closed

Empty reply from ncss dataset page for NetCDF files #1016

ghost opened this issue Jan 29, 2018 · 5 comments

Comments

@ghost
Copy link

ghost commented Jan 29, 2018

I have an issue with air quality NetCDF files from Copernicus.

When I try to get a NetCDF dataset page, I get an empty reply:

$ curl -D - 'http:https://172.24.0.3:8080/thredds/ncss/weather/archive/W_fr-meteofrance,MODEL,ENSEMBLE+FORECAST+SURFACE+NO2+0H24H_C_LFPW_20171219000000.nc/dataset.html'
HTTP/1.1 200 OK
Content-Length: 0
Date: Mon, 29 Jan 2018 09:23:06 GMT
Server: Apache

Here is the file, gzipped so that Github upload feature accepts it:

W_fr-meteofrance,MODEL,ENSEMBLE+FORECAST+SURFACE+OLIVEPOLLEN+0H24H_C_LFPW_20180129000000.nc.gz

I got this file from Copernicus by selecting these options:

pollen-selection

Here is an other example which is causing the same issue:

W_fr-meteofrance,MODEL,ENSEMBLE+FORECAST+SURFACE+NO2+0H24H_C_LFPW_20171219000000.nc.gz

It works fine with other NetCDF files. Actually if I download the GRIB version of the same data and convert it to NetCDF using ecCodes' grib_to_netcdf, then I can get the dataset page from thredds. So something must be weird with NetCDF files produced by Copernicus.

@cofinoa
Copy link
Contributor

cofinoa commented Jan 29, 2018

@amarandon

The problem is that the time variable doesn't have the right units to be identified as a Time coordinate, needed by the ncss service

You should contact to the data provider and ask to fix that. BTW, the metadata should be improved and be more explicit to avoid ambiguities and interpretations.

Meanwhile and to check that the ncss service it's working you can add a ncml file with this content:

<?xml version="1.0" encoding="UTF-8"?>
<netcdf xmlns="http:https://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2" 
     location="W_fr-meteofrance,MODEL,ENSEMBLE+FORECAST+SURFACE+OLIVEPOLLEN+0H24H_C_LFPW_20180129000000.nc">
  <variable name="time">
    <attribute name="units" value="hours since 2018-01-29T00:00:00Z" />
  </variable>
</netcdf>

@ghost
Copy link
Author

ghost commented Jan 29, 2018

@cofinoa Thanks a lot for your quick reply! It works with the ncml file you provided. I guess I can close this issue then.

I can see that the file only contains hours as unit of the time variable. I understand now that it should also specify a start time, as in your example.

When contacting the data provider, do you know if there is an authoritative reference regarding unit formats that I should point them to? Since their files are usable with tools like ncview or Panoply, I anticipate "resistance" ;)

@ghost ghost closed this as completed Jan 29, 2018
@cofinoa
Copy link
Contributor

cofinoa commented Jan 29, 2018

Dear @amarandon

Please point to them to the C3S CDM: Common data model specification - v1.0

That specification is based on the CF1.6.

P.S: You can also pass them my profile to contact me: @cofinoa

@ghost
Copy link
Author

ghost commented Jan 31, 2018

We created a ticket for Copernicus, referring this issue

@ghost
Copy link
Author

ghost commented Feb 9, 2018

For the record, we received a reply from the ECMWF saying that they acknowledge the issue and intend to fix it in the future. However as they don't guarantee CF-compliance, they can't tell when it will be done.

This issue was closed.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant