Commits

Commits on Sep 25, 2023

[Data] Add Stephanie as data code owner (#39829 )
c21
committedSep 25, 2023

Commits on Sep 15, 2023

[Data] Fall back to fetch files info in parallel for multiple directories (#39592 )
c21
committedSep 15, 2023

Commits on Aug 28, 2023

[Data] Change user provided rules methods (#38931 )
c21
committedAug 28, 2023

Commits on Aug 25, 2023

[Data] Restructure the user-provided optimizer rules file (#38829 )
c21
committedAug 25, 2023

Commits on Aug 24, 2023

[Data] Retry open files with expotential backoff (#38773 )
c21
committedAug 24, 2023
[Data] Store serialized ParquetFileFragment in _ParquetDatasourceReader (#38797 )
c21
committedAug 24, 2023

Commits on Aug 22, 2023

[Data] Avoid passing local_uri to all non-Parquet data sources (#38719 )
c21
committedAug 22, 2023

Commits on Aug 18, 2023

[Data] Support class constructor args for map() and flat_map() (#38606 )
c21
committedAug 18, 2023

Commits on Aug 17, 2023

Revert "[Data] Find partitions refactor (#38460 )" (#38548 )
c21
committedAug 17, 2023
[Data] Bump up timeout for test_numpy (#38534 )
c21
committedAug 17, 2023

Commits on Aug 16, 2023

[Data] Change FileMetadataShuffler interface to take tuple (#38508 )
c21
committedAug 16, 2023
[Data] Postpone reader.get_read_tasks until execution (#38373 )
c21
committedAug 16, 2023

Commits on Aug 15, 2023

[Data] Fix to_pandas() incomplete docstring (#38445 )
c21
committedAug 15, 2023

Commits on Jul 22, 2023

[Data] Support JSONL file format (#37637 )
c21
committedJul 22, 2023

Commits on May 4, 2023

Update data team code owners (#35058 )
c21
committedMay 4, 2023

Commits on Apr 28, 2023

[Data] Cooperatively exit producer threads for iter_batches (#34819 )
c21
committedApr 28, 2023
[Data] fix CI test failing with dashboard error (#34839 )
c21
committedApr 28, 2023

Commits on Apr 26, 2023

[Data] Fix nightly test import of pipelined_training.py (#34795 )
c21
committedApr 26, 2023

Commits on Apr 18, 2023

[Data] Update code owners of Ray Data (#34506 )
c21
committedApr 18, 2023

Commits on Apr 5, 2023

[Data] Fix actor pool scale up logic to consider min_workers (#34093 )
c21
committedApr 5, 2023

Commits on Mar 30, 2023

[Datasets] Change from warnings.warn to logger.warning (#33900 )
c21
committedMar 30, 2023

Commits on Mar 28, 2023

Commits on Mar 25, 2023

[Datasets] Delete unused code in release test (#33687 )
c21
committedMar 25, 2023

Commits on Mar 24, 2023

[Datasets] Do not skip duplicated path in DefaultFileMetadataProvider (#33684 )
c21
committedMar 24, 2023
[Datasets] Fix zip stage to preserve order when executing the other side (#33649 )
c21
committedMar 24, 2023

Commits on Mar 23, 2023

[Datasets] Fix docstring of TFRecordDatasource (#33613 )
c21
committedMar 23, 2023
[Datasets] Correct link of batch inference (#33614 )
c21
committedMar 23, 2023

Commits on Mar 16, 2023

[Datasets] Add sub progress bar support for AllToAllOperator (#33302 )
c21
committedMar 16, 2023
[Datasets] Force all operator/stage name to be in PascalCase (#33332 )
c21
committedMar 16, 2023

Commits on Mar 14, 2023

[Datasets] Run _get_read_tasks with NodeAffinitySchedulingStrategy (#33212 )

c21
and
matthewdeng
committedMar 14, 2023
[Datasets] Refactor iter_rows() for DatasetIterator classes (#33257 )
c21
committedMar 14, 2023

Commits on Mar 13, 2023

[Datasets] Make telemetry record usage by default (#33168 )
c21
committedMar 13, 2023

Commits on Mar 9, 2023

[Datasets] Remove the assertion for ds.stats() in test_dataset_image.py (#33171 )
c21
committedMar 9, 2023