Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make write an operator as part of the execution plan #32015

Merged
merged 51 commits into from
Feb 8, 2023
Merged
Changes from 1 commit
Commits
Show all changes
51 commits
Select commit Hold shift + click to select a range
edc51bd
Fix read_tfrecords_benchmark nightly test
jianoaix Dec 8, 2022
61f4d6d
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Dec 14, 2022
a33a943
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Dec 16, 2022
36ebe52
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Dec 16, 2022
ce6763e
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Dec 19, 2022
0e2c29e
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Dec 21, 2022
f2b6ed0
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Dec 22, 2022
bb6c5c4
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Jan 4, 2023
540fe79
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Jan 10, 2023
edad7d0
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Jan 10, 2023
60cc079
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Jan 11, 2023
a3d3980
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Jan 12, 2023
001579c
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Jan 17, 2023
8aeed6c
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Jan 18, 2023
7a9a49b
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Jan 19, 2023
ef97167
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Jan 20, 2023
6f0563c
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Jan 21, 2023
bcec4d6
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Jan 24, 2023
ddef4e5
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Jan 25, 2023
fc9a175
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Jan 25, 2023
f0e90b7
Merge branch 'master' of https://github.com/ray-project/ray
jianoaix Jan 26, 2023
0c820ea
Merge branch 'master' of https://github.com/ray-project/ray into writ…
jianoaix Jan 26, 2023
253da6a
Make write an operator as part of the execution plan
jianoaix Jan 27, 2023
514ec14
fix / fix do_write
jianoaix Jan 28, 2023
204ea5f
Merge branch 'master' of https://github.com/ray-project/ray into writ…
jianoaix Jan 28, 2023
b75bf49
Fix the merge
jianoaix Jan 28, 2023
6a28257
fix arg passing
jianoaix Jan 28, 2023
3082e52
lint
jianoaix Jan 28, 2023
5ddfdc0
Reconcile taskcontext
jianoaix Jan 31, 2023
3843ff4
Reconcile taskcontext continued
jianoaix Jan 31, 2023
012a413
Merge branch 'master' of https://github.com/ray-project/ray into writ…
jianoaix Jan 31, 2023
84a74f0
Use task context in write op
jianoaix Jan 31, 2023
bb2a474
fix test
jianoaix Jan 31, 2023
ad5f7c7
feedback: backward compatibility
jianoaix Jan 31, 2023
a77053a
fix
jianoaix Jan 31, 2023
554171a
test write fusion
jianoaix Jan 31, 2023
1ba1b9f
Result of write operator; datasource callbacks
jianoaix Feb 1, 2023
5ced246
Handle an empty list on failure
jianoaix Feb 3, 2023
43eca29
execute the plan in-place in write_datasource
jianoaix Feb 3, 2023
f25d54b
Keep write_datasource semantics diff-neutral regarding the plan
jianoaix Feb 3, 2023
c5ddf07
Merge branch 'master' of https://github.com/ray-project/ray into writ…
jianoaix Feb 3, 2023
1d58e13
disable the write_XX in new optimizer: it's not supported yet
jianoaix Feb 3, 2023
d309dbd
fix comment
jianoaix Feb 3, 2023
21a50db
refactor: do_write() calls direct_write() to reduce code duplication
jianoaix Feb 4, 2023
a84e27b
refactor: for mongo datasource do_write
jianoaix Feb 4, 2023
8879df0
backward compatible
jianoaix Feb 7, 2023
d6873e1
rename: direct_write -> write
jianoaix Feb 7, 2023
10ef980
unnecessary test removed
jianoaix Feb 7, 2023
48e9415
fix
jianoaix Feb 7, 2023
87dc925
deprecation message/logging
jianoaix Feb 7, 2023
b77ca8d
deprecation logging
jianoaix Feb 7, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
  • Loading branch information
jianoaix committed Jan 4, 2023
commit bb6c5c43249eed04b4a93854cb3917ca7e9b284d

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.