Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BEAM-252] Make Regex Transform #506

Closed
wants to merge 3 commits into from

Conversation

eljefe6a
Copy link
Contributor

Jira issue BEAM-252 Make Regex Transform. Adding a pre-built transform for Regex.

}

@Test
public void testReplaceFirstMixed() {
Copy link
Member

@kennknowles kennknowles Jun 21, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tests that run a pipeline now must be annotated with @NeedsRunner, since there is no runner in the core SDK.

@eljefe6a
Copy link
Contributor Author

@kennknowles All passing now.

@eljefe6a
Copy link
Contributor Author

eljefe6a commented Jul 1, 2016

@kennknowles Anything you need from on this PR?

@kennknowles
Copy link
Member

Nope, just a bit backlogged. Thanks for the ping!

@dhalperi
Copy link
Contributor

dhalperi commented Jul 7, 2016

[ignore me, metadata only] R: @kennknowles

@eljefe6a
Copy link
Contributor Author

@kennknowles I've updated the PR to the latest DoFN interface. Should make for an easier merge.

@eljefe6a
Copy link
Contributor Author

eljefe6a commented Oct 7, 2016

@kennknowles I was looking at the WordCount code and realized that should be in RegexTransform. I added a split method that will allow the word splitting portion of WordCount to be done as words.apply(RegexTransform.split("\W*"));.

@kennknowles
Copy link
Member

@eljefe6a indeed, very appropriate. This is still on my radar FYI.

@eljefe6a
Copy link
Contributor Author

eljefe6a commented Nov 4, 2016

@kennknowles Are you ok with me merging this?

@asfgit asfgit closed this in f6a9733 Nov 7, 2016
@kennknowles
Copy link
Member

Actually, I had some more feedback for tightening up the API, and was working on a pull-request-for-your-pull-request. We've been considering moving non-core transforms to extensions. I'll put something together.

Sorry this didn't get prompt attention, but we really need to stick to waiting for an LGTM comment or GitHub "approval".

@eljefe6a
Copy link
Contributor Author

eljefe6a commented Nov 7, 2016

I thought this was approved. My mistake.

@dhalperi
Copy link
Contributor

dhalperi commented Nov 7, 2016

The other thing I would add is that for very old branches the precommits need to be run.

Specifically, if you're the author: rebase and push so that Jenkins re-runs.

If not, it's trickier -- the merging committer can run the precommit manually (e.g., mvn clean verify -Prelease) before merging.

This merge immediately broke the build. I think Kenn has pushed fixes, but we should prevent these build breaks.

@eljefe6a eljefe6a deleted the RegexTransform branch January 6, 2017 16:54
johnjcasey pushed a commit to johnjcasey/beam that referenced this pull request Feb 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants