Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ci] move rllib small-gpu tests to civ2 #40439

Merged
merged 2 commits into from
Oct 19, 2023
Merged

[ci] move rllib small-gpu tests to civ2 #40439

merged 2 commits into from
Oct 19, 2023

Conversation

can-anyscale
Copy link
Collaborator

@can-anyscale can-anyscale commented Oct 18, 2023

  • rllib uses 'gpu' and 'multi-gpu' tag which confuses bazel query tag since it takes the input as a regex. Updated ray_ci to strictly query for an exact match of tag
  • we cannot parallelize this job because the machine has only one core

Test:

  • CI

@can-anyscale can-anyscale force-pushed the can-ci-09 branch 3 times, most recently from 653e0fb to 248b1b9 Compare October 18, 2023 18:08
@can-anyscale can-anyscale changed the title migrate rllib gpu tests to civ2 [ci] migrate rllib small-gpu tests to civ2 Oct 18, 2023
@can-anyscale can-anyscale marked this pull request as ready for review October 18, 2023 21:13
@can-anyscale can-anyscale changed the title [ci] migrate rllib small-gpu tests to civ2 [ci] move rllib small-gpu tests to civ2 Oct 18, 2023
@@ -77,6 +77,20 @@ steps:
depends_on: rllibbuild
job_env: forge

- label: ":brain: rllib: gpu tests"
tags: rllib
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add gpu tag?

The word boundary is escaped twice because it is used in a python string and then
used again as a string in bazel query.
"""
return f"\\\\b{tag}\\\\b"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

could you add a unit test for this function? just to illustrate how this works?

def test_get_tag_matcher() -> None:
assert re.match(
# simulate shell character escaping
bytes(_get_tag_matcher("tag"), "utf-8").decode("unicode_escape"),
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why is this using unicode_escape?

Copy link
Collaborator Author

@can-anyscale can-anyscale Oct 19, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It evaluates the escape character in a string, for example, the string 'a\\nb' will be evaluated to 'a\nb', which is what happen to a string in a shell command

@can-anyscale can-anyscale merged commit 149536d into master Oct 19, 2023
39 of 42 checks passed
@can-anyscale can-anyscale deleted the can-ci-09 branch October 19, 2023 05:37
jonathan-anyscale pushed a commit to jonathan-anyscale/ray that referenced this pull request Oct 26, 2023
- rllib uses 'gpu' and 'multi-gpu' tag which confuses bazel query tag since it takes the input as a regex. Updated ray_ci to strictly query for an exact match of tag
- we cannot parallelize this job because the machine has only one core

Signed-off-by: Cuong Nguyen <[email protected]>
jonathan-anyscale pushed a commit to jonathan-anyscale/ray that referenced this pull request Oct 26, 2023
- rllib uses 'gpu' and 'multi-gpu' tag which confuses bazel query tag since it takes the input as a regex. Updated ray_ci to strictly query for an exact match of tag
- we cannot parallelize this job because the machine has only one core

Signed-off-by: Cuong Nguyen <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants