Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

data #1

Closed
sunshine795 opened this issue Apr 22, 2022 · 9 comments
Closed

data #1

sunshine795 opened this issue Apr 22, 2022 · 9 comments

Comments

@sunshine795
Copy link

Hello, can you provide some data('../../../../../../mnt/data/scheepensd94dm/')?

@dscheepens
Copy link
Owner

Hi, best if you download the data yourself from the Copernicus Climate Data Store. I've added the file grib_to_numpy.py which includes the link to the data and transforms from .grib to .npy. Don't forget to change the 'root' to your root (also in main.py).

@sunshine795
Copy link
Author

Thank you very much. I'll try it on

@sunshine795
Copy link
Author

Hello, my Windows system cannot install pygrib library, can I consider using NetCDF data format?

@dscheepens
Copy link
Owner

Do you have pip installed and tried:
pip install pyproj
pip install pygrib
?
The library should work for windows.

@sunshine795
Copy link
Author

Hello, I have downloaded the data to the required directory, how should I train it next? For example, what is the order in which files are run?

@dscheepens
Copy link
Owner

Hi, just set up in main.py which parameters you want to use (e.g. loss function, number of layers etc.) and then run: python3 main.py

Make sure you have all the relevant packages installed

@dscheepens
Copy link
Owner

Please let me know if there are any other issues. The code still needs a bit of curating to be sure.

@sunshine795
Copy link
Author

Hi,in file "loss_functions.py", "ser_t = ((preds[indices]-targets[indices])**2).mean()"position error is "IndexError: too many indices for tensor of dimension 3".

How to solve it?

@dscheepens
Copy link
Owner

Hi, is your data of dimension (N, 12, 64, 64) where N is the number of samples?

You can also just use the standard MSE loss if you just want to get the code running. We tested the SERA loss in our paper but you can of course use any loss.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants