Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove ray.tasks() from API. #7807

Merged
merged 6 commits into from
Apr 1, 2020
Merged

Conversation

robertnishihara
Copy link
Collaborator

This also removes some other unnecessary code.

@robertnishihara
Copy link
Collaborator Author

robertnishihara commented Mar 30, 2020

cc @edoakes regarding removing ray.tasks from the API.

@AmplabJenkins
Copy link

Can one of the admins verify this patch?

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/23912/
Test PASSed.

Copy link
Contributor

@edoakes edoakes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Beautiful! I believe we can also remove the TaskSpec and Task wrappers in includes/task.pxi and includes/task.pxd now. Could you try tearing those out too?

Comment on lines -137 to -138
# TODO(edoakes): there are dummy object IDs being created in
# includes/task.pxi before the core worker is initialized.
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@edoakes can you confirm that it's ok to remove this comment?

Copy link
Contributor

@edoakes edoakes Mar 31, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This comment means we should be able to remove the hasattr check below and the related in_core_worker flag. Let's either remove those or leave the TODO modified to say those can be removed now.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done. Initially tried removing the code, but ran into some errors, so decided to just update the comment.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In particular, ran into the error

AttributeError: 'Worker' object has no attribute 'core_worker'

here

@@ -167,6 +167,39 @@ def f():
assert "success" in out


def test_cleanup_on_driver_exit(call_ray_start):
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Adding this test to replace test_monitors.py (which wasn't even being run anyway).

Copy link
Contributor

@edoakes edoakes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great!

@AmplabJenkins
Copy link

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/24054/
Test FAILed.

@AmplabJenkins
Copy link

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/24063/
Test FAILed.

@AmplabJenkins
Copy link

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/24076/
Test FAILed.

@edoakes edoakes merged commit b011c60 into ray-project:master Apr 1, 2020
@robertnishihara robertnishihara deleted the raytasks branch April 1, 2020 16:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants