Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

dask_on_ray_100gb_sort release test failure #32590

Closed
cadedaniel opened this issue Feb 15, 2023 · 2 comments
Closed

dask_on_ray_100gb_sort release test failure #32590

cadedaniel opened this issue Feb 15, 2023 · 2 comments
Assignees
@scv119
Labels
bug Something that is supposed to be working; but isn't core Issues that should be addressed in Ray Core

Comments

@cadedaniel
Copy link
Member

BK: https://buildkite.com/ray-project/release-tests-branch/builds/1398#01864cdd-bfca-4120-a01c-395532999a3e

ray.exceptions.ObjectFetchTimedOutError: Failed to retrieve object 9f1bf41aa430eaf8ffffffffffffffffffffffff020000004b000000. To see information about where this ObjectRef was created in Python, set the environment variable RAY_record_ref_creation_sites=1 during `ray start` and `ray.init()`.
--
  |  
  | Fetch for object 9f1bf41aa430eaf8ffffffffffffffffffffffff020000004b000000 timed out because no locations were found for the object. This may indicate a system-level bug.
  |  
@cadedaniel cadedaniel added core Issues that should be addressed in Ray Core P0 Issues that should be fixed in short order bug Something that is supposed to be working; but isn't labels Feb 15, 2023
@scv119 scv119 removed the P0 Issues that should be fixed in short order label Mar 9, 2023
@scv119
Copy link
Contributor

scv119 commented Mar 9, 2023 •
edited
Loading

the hypothesis is #32046 is the root cause of this issue.

@scv119
Copy link
Contributor

scv119 commented Apr 19, 2023

will reopen it if the problem still exists!

@scv119 scv119 closed this as completed Apr 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@scv119 scv119

Labels
bug Something that is supposed to be working; but isn't core Issues that should be addressed in Ray Core
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@scv119 @cadedaniel