-
-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
mfdataset - ds.encoding["source"] to retrieve filename not valid key #9142
Labels
Comments
this depends on what |
fileset is a list of s3_fs objects: s3_fs = s3fs.S3FileSystem(anon=True)
remote_files = [f"s3:https://{bucket_name}/{key}" for key in object_keys]
fileset = [s3_fs.open(file) for file in remote_files] |
then #8923 will fix this! |
3 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
What happened?
Looking at the doc https://docs.xarray.dev/en/stable/generated/xarray.open_mfdataset.html
I expected to be able to use ds.encoding["source"] in my preprocess function to retrieve the filename. However I get
What did you expect to happen?
I expected the doc to be correct? unless I missed something trivial.
Minimal Complete Verifiable Example
MVCE confirmation
Relevant log output
Anything else we need to know?
No response
Environment
xarray: 2024.6.0
pandas: 2.2.2
numpy: 1.26.4
scipy: 1.13.1
netCDF4: 1.7.1
pydap: None
h5netcdf: 1.3.0
h5py: 3.11.0
zarr: 2.18.2
cftime: 1.6.4
nc_time_axis: 1.4.1
iris: None
bottleneck: 1.3.8
dask: 2024.6.0
distributed: 2024.6.0
matplotlib: 3.9.0
cartopy: None
seaborn: 0.13.2
numbagg: 0.8.1
fsspec: 2024.6.0
cupy: None
pint: None
sparse: None
flox: 0.9.7
numpy_groupies: 0.11.1
setuptools: 70.0.0
pip: 24.0
conda: None
pytest: 8.2.2
mypy: 1.10.0
IPython: 7.34.0
sphinx: None
The text was updated successfully, but these errors were encountered: