Skip to content

Commit

Permalink
[Data] Remove unnecessary filesystem wrapping (ray-project#38299)
Browse files Browse the repository at this point in the history
In FileBasedDatasource.write, we wrap then immediately unwrap the filesystem object. Since there's no point in wrapping the filesystem object, this PR removes the line. For context, this logic is likely from legacy code that was refactored by ray-project#37986.

Signed-off-by: Balaji Veeramani <[email protected]>
Signed-off-by: harborn <[email protected]>
  • Loading branch information
bveeramani authored and harborn committed Aug 17, 2023
1 parent 9f29dda commit 23cef4b
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion python/ray/data/datasource/file_based_datasource.py
Original file line number Diff line number Diff line change
Expand Up @@ -314,7 +314,6 @@ def write(
# if an S3 URI is provided.
tmp = _add_creatable_buckets_param_if_s3_uri(path)
filesystem.create_dir(tmp, recursive=True)
filesystem = _wrap_s3_serialization_workaround(filesystem)

fs = _unwrap_s3_serialization_workaround(filesystem)

Expand Down

0 comments on commit 23cef4b

Please sign in to comment.