Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BEAM-9569] disable coder inference for rows #10990

Merged
merged 3 commits into from
Mar 23, 2020

Conversation

reuvenlax
Copy link
Contributor

No description provided.

Schema rightSchema = rightRows.getSchema();
if (!leftSchema.typesEqual(rightSchema)) {
throw new IllegalArgumentException(
"Can't intersect two tables with different schemas."
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the base class, so shouldn't be calling it "intersect". Incidentally I don't think having a base class adds much value here, so inlining or inverting would be a-ok.

while (iter.hasNext()) {
ctx.output(iter.next());
for (int i = 0; i < numLeftRows + numRightRows; i++) {
o.output(key);
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This optimization seems to have nothing to do with disabling coder inference. Please split into separate commit so git history shows it.

@reuvenlax
Copy link
Contributor Author

@kennknowles I've removed the premature optimization. I decided to leave the base class for now - would prefer to leave that as a refactoring cleanup for another PR.

Note: support for nullable fields in this PR (as this PR exposed bugs in the Schema transforms) is also pulled out into pr/11046. I plan on merging 11046 first and rebasing this one on top, so those changes will not be included in this merge.

@reuvenlax
Copy link
Contributor Author

@kennknowles the Select changes have now been rebased away

@reuvenlax reuvenlax changed the title disable coder inference for rows [BEAM-9569] disable coder inference for rows Mar 23, 2020
@reuvenlax
Copy link
Contributor Author

R: @dpmills

@reuvenlax
Copy link
Contributor Author

Run Java PreCommit

@dpmills
Copy link
Contributor

dpmills commented Mar 23, 2020

LGTM

@reuvenlax reuvenlax merged commit fb59b6a into apache:master Mar 23, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants