Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Opening a large CSV displays a blank screen with no user feedback for a long time #75

Open
rogerdahl opened this issue Mar 12, 2024 · 0 comments
Assignees
Labels
bug Bug EDI Environmental Data Initiative medium priority Medium priority

Comments

@rogerdahl
Copy link
Collaborator

E.g., initially opening the 20GB Europe_glcp_extended.csv from edi.394.5 in prod took around 3 1/2 minutes total, and the processing spinner was showing only during the last half or so, of that time.

The issue is probably that the CSV related cache entries are created at the same time as the EML based ones.

Todo:

  • Consider disconnecting the creation of EML based cache entries from the CSV related ones.

  • Consider adding some sort of loading screen.

  • Check to make sure that DeX in prod is finding the CSVs in the NFS mount. The download path for objects in PASTA should only kick in for staging and development. Even if reading from the full CSV from NFS mount is no faster than downloading it, reading from NFS will be faster when only part of the CSV is to be loaded (since the full CSV has to be downloaded even when only part of it is to be loaded).

@rogerdahl rogerdahl added bug Bug medium priority Medium priority EDI Environmental Data Initiative labels Mar 12, 2024
@rogerdahl rogerdahl self-assigned this Mar 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Bug EDI Environmental Data Initiative medium priority Medium priority
Projects
Status: ToDo
Development

No branches or pull requests

1 participant