Commits

Commits on Mar 29, 2023

[Datasets] Add missing passthrough args to read_images() (ray-project#32942 )
clarkzinzow
committedMar 29, 2023

Commits on Mar 27, 2023

[Datasets] [Operator Fusion - 3/N] Add operator fusion benchmark. (ray-project#32747 )
clarkzinzow
committedMar 27, 2023

Commits on Mar 25, 2023

[Datasets] Add autoscaling cluster support to streaming executor. (ray-project#33204 )

committedMar 25, 2023

Commits on Mar 24, 2023

[Core] Turn on Python test linting for Core tests. (ray-project#29622 )

clarkzinzow
and
Yard1
committedMar 24, 2023

Commits on Mar 9, 2023

[Datasets] Improve performance of DefaultFileMetaProvider. (ray-project#33117 )
clarkzinzow
committedMar 9, 2023

Commits on Feb 24, 2023

Commits on Feb 23, 2023

[Datasets] [Operator Fusion - 2/N] Data layer performance/bug fixes and tweaks. (ray-project#32744 )
clarkzinzow
committedFeb 23, 2023

Commits on Feb 14, 2023

[Datasets] Always preserve order for the BulkExecutor. (ray-project#32437 )
clarkzinzow
committedFeb 14, 2023

Commits on Feb 13, 2023

[Datasets] Track bundles object store utilization as soon as they're added to an operator (ray-project#32482 )
clarkzinzow
committedFeb 13, 2023

Commits on Feb 10, 2023

[Datasets] Make ray.data.from_* APIs lazy. (ray-project#32390 )
clarkzinzow
committedFeb 10, 2023
[Datasets] [Docs] Update docs to reflect lazy-by-default execution model. (ray-project#32387 )
clarkzinzow
committedFeb 10, 2023

Commits on Feb 1, 2023

Fix dynamic block splitting for new backend. (ray-project#32139 )
clarkzinzow
committedFeb 1, 2023
[CI] [Datasets] Run Datasets test suites on AIR changes (ray-project#32118 )
clarkzinzow
committedFeb 1, 2023

Commits on Jan 31, 2023

[Datasets] [Operator Fusion - 1/2] Add operator fusion to new execution planner. (ray-project#32095 )
clarkzinzow
committedJan 31, 2023

Commits on Jan 28, 2023

[Datasets] [Autoscaling Actor Pool - 2/2] Add autoscaling support to MapOperator actor pool. (ray-project#31987 )
clarkzinzow
committedJan 28, 2023

Commits on Jan 27, 2023

[Datasets] [Autoscaling Actor Pool - 1/2] Refactor MapOperator, execution state, and task submitters. (ray-project#31986 )
clarkzinzow
committedJan 27, 2023

Commits on Jan 19, 2023

[Datasets] Fix Torch tensor memory leak test. (ray-project#31748 )
clarkzinzow
committedJan 19, 2023

Commits on Jan 18, 2023

Commits on Jan 13, 2023

[Datasets] Add actor pool implementation for MapOperator. (ray-project#31597 )
clarkzinzow
committedJan 13, 2023

Commits on Dec 22, 2022

[Datasets] Add feature guide section for configuring batch_size in .map_batches() (ray-project#29117 )
clarkzinzow
committedDec 22, 2022

Commits on Dec 19, 2022

[Datasets] [Hotfix] Remove Arrow 8 upper-bound in ray[data] extra (ray-project#31186 )
clarkzinzow
committedDec 19, 2022

Commits on Dec 13, 2022

[Datasets] [Arrow 7+ Support - 4/N] [RFC] Add zero-copy batch API for ds.map_batches(). (ray-project#30000 )
clarkzinzow
committedDec 13, 2022

Commits on Dec 7, 2022

[Datasets] Avoid torch.as_tensor() memory leak in ds.to_torch() (ray-project#30738 )
clarkzinzow
committedDec 7, 2022

Commits on Dec 5, 2022

[Datasets] Return ndarray dicts for single-column tabular datasets. (ray-project#30448 )
clarkzinzow
committedDec 5, 2022

Commits on Dec 1, 2022

[Core] Fix graceful task cancellation of queued tasks. (ray-project#30761 )
clarkzinzow
committedDec 1, 2022

Commits on Nov 29, 2022

Commits on Nov 27, 2022

[Datasets] Fix ndarray representation of single-element ragged tensor slices. (ray-project#30514 )
clarkzinzow
committedNov 27, 2022

Commits on Nov 25, 2022

[Datasets] Move to full serializer implementation, list of struct array serialization. (ray-project#30627 )
clarkzinzow
committedNov 25, 2022

Commits on Nov 22, 2022

[Datasets] Revert to manual buffer copying custom Arrow serializer. (ray-project#30532 )
clarkzinzow
committedNov 22, 2022

Commits on Nov 9, 2022

[Datasets] [Arrow 7+ Support - 3/N] Add support for Arrow 8, 9, 10, and nightly. (ray-project#29999 )
clarkzinzow
committedNov 9, 2022