Skip to content

Commit

Permalink
[ci/release] Use job-based file manager for SDK runner per default (r…
Browse files Browse the repository at this point in the history
…ay-project#31493)

Signed-off-by: Kai Fricke <[email protected]>

Release tests are currently failing with an error on file upload (botocore.exceptions.DataNotFoundError: Unable to load data for: ec2/2016-11-15/endpoint-rule-set-1). This is likely because some tests are using an anyscale push-based API to upload files. By switching to the job-based filemanager for all tests the upload issue should be mitigated.

Please note that execution will still happen with SDK commands for those tests that haven't specified to use jobs for execution, so actual test execution should be unaffected.

Signed-off-by: tmynn <[email protected]>
  • Loading branch information
krfricke authored and tamohannes committed Jan 25, 2023
1 parent 73c9562 commit 40ca552
Show file tree
Hide file tree
Showing 2 changed files with 1 addition and 5 deletions.
2 changes: 1 addition & 1 deletion release/ray_release/glue.py
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@
}

command_runner_to_file_manager = {
SDKRunner: SessionControllerFileManager,
SDKRunner: JobFileManager, # Use job file manager per default
ClientRunner: RemoteTaskFileManager,
JobRunner: JobFileManager,
}
Expand Down
4 changes: 0 additions & 4 deletions release/release_tests.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -3481,7 +3481,6 @@
timeout: 7200
script: python stress_tests/test_placement_group.py
type: sdk_command
file_manager: sdk

- name: shuffle_1tb_5000_partitions
group: core-multi-test
Expand Down Expand Up @@ -4319,7 +4318,6 @@
script: python read_tfrecords_benchmark.py

type: sdk_command
file_manager: sdk

- name: map_batches_benchmark_single_node
group: core-dataset-tests
Expand All @@ -4337,7 +4335,6 @@
script: python map_batches_benchmark.py

type: sdk_command
file_manager: sdk

- name: iter_batches_benchmark_single_node
group: core-dataset-tests
Expand All @@ -4355,7 +4352,6 @@
script: python iter_batches_benchmark.py

type: sdk_command
file_manager: sdk

- name: pipelined_training_50_gb
group: core-dataset-tests
Expand Down

0 comments on commit 40ca552

Please sign in to comment.