Skip to content

Commit

Permalink
Beam Katas - Update Beam to v2.12.0, javadoc, pydoc to use 'current' (a…
Browse files Browse the repository at this point in the history
…pache#8735)

* Update Beam version to 2.12.0

* Update Beam version to 2.12.0

* Update javadoc links to use 'current' instead of specific version

* Update pydoc links to use 'current' instead of specific version
  • Loading branch information
henryken authored and pabloem committed Jun 3, 2019
1 parent 2959fcc commit f50e7d0
Show file tree
Hide file tree
Showing 43 changed files with 194 additions and 194 deletions.
122 changes: 61 additions & 61 deletions learning/katas/java/.idea/study_project.xml

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
Expand Up @@ -21,5 +21,5 @@ <h2>Aggregation - Count</h2>
<p>In this task, we are going to count the number of elements from an input.</p>
<br>
<br>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Count.html">Count</a></div>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Count.html">Count</a></div>
</html>
Original file line number Diff line number Diff line change
Expand Up @@ -21,5 +21,5 @@ <h2>Aggregation - Max</h2>
<p>In this task, we are going to compute the maximum of the elements from an input.</p>
<br>
<br>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Max.html">Max</a></div>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Max.html">Max</a></div>
</html>
Original file line number Diff line number Diff line change
Expand Up @@ -21,5 +21,5 @@ <h2>Aggregation - Mean</h2>
<p>In this task, we are going to compute the mean/average of all elements from an input.</p>
<br>
<br>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Mean.html">Mean</a></div>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Mean.html">Mean</a></div>
</html>
Original file line number Diff line number Diff line change
Expand Up @@ -21,5 +21,5 @@ <h2>Aggregation - Min</h2>
<p>In this task, we are going to compute the minimum of the elements from an input.</p>
<br>
<br>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Min.html">Min</a></div>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Min.html">Min</a></div>
</html>
Original file line number Diff line number Diff line change
Expand Up @@ -21,5 +21,5 @@ <h2>Aggregation - Sum</h2>
<p>In this task, we are going to compute the sum of all elements from an input.</p>
<br>
<br>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Sum.html">Sum</a></div>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Sum.html">Sum</a></div>
</html>
4 changes: 2 additions & 2 deletions learning/katas/java/Common Transforms/Filter/Filter/task.html
Original file line number Diff line number Diff line change
Expand Up @@ -20,10 +20,10 @@
<h2>Filter</h2>
<p>The Beam SDKs provide language-specific ways to simplify how you provide your DoFn implementation.</p>
<p>In this task, we are going to implement a filter function that filters out the odd numbers by using
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Filter.html">
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Filter.html">
Filter</a>.
</p>
<br>
<br>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Filter.html">Filter.by(...)</a></div>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Filter.html">Filter.by(...)</a></div>
</html>
6 changes: 3 additions & 3 deletions learning/katas/java/Common Transforms/Filter/ParDo/task.html
Original file line number Diff line number Diff line change
Expand Up @@ -19,12 +19,12 @@
<html>
<h2>Filter using ParDo</h2>
<p>In this task, we are going to implement a filter function that filters out the even numbers by using
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/DoFn.html">
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/DoFn.html">
DoFn</a>.
</p>
<br>
<br>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/ParDo.html">ParDo</a>
with <a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/DoFn.html">DoFn</a>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/ParDo.html">ParDo</a>
with <a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/DoFn.html">DoFn</a>
and only output the intended element.</div>
</html>
Original file line number Diff line number Diff line change
Expand Up @@ -20,13 +20,13 @@
<h2>CoGroupByKey</h2>
<p>CoGroupByKey performs a relational join of two or more key/value PCollections that have the same key type.</p>
<p>In this task, we are going to implement a
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/join/CoGroupByKey.html">
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/join/CoGroupByKey.html">
CoGroupByKey</a> transform that join words by its first alphabetical letter, and then produces the toString()
representation of the WordsAlphabet model.
</p>
<br>
<br>
<div class='hint'>Refer to <a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/join/CoGroupByKey.html">CoGroupByKey</a>,
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/values/TupleTag.html">TupleTag</a>,
and <a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/join/CoGbkResult.html">CoGbkResult</a>.</div>
<div class='hint'>Refer to <a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/join/CoGroupByKey.html">CoGroupByKey</a>,
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/values/TupleTag.html">TupleTag</a>,
and <a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/join/CoGbkResult.html">CoGbkResult</a>.</div>
</html>
Original file line number Diff line number Diff line change
Expand Up @@ -27,12 +27,12 @@ <h2>Combine - BinaryCombineFn</h2>
the value collection.</p>
<p>BinaryCombineFn is used for implementing combiners that are more easily expressed as binary operations.</p>
<p>In this task, we are going to implement the summation of BigInteger using
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Combine.BinaryCombineFn.html">
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Combine.BinaryCombineFn.html">
Combine.BinaryCombineFn</a>.
</p>
<br>
<br>
<div class='hint'>Extend the
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Combine.BinaryCombineFn.html">Combine.BinaryCombineFn</a>
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Combine.BinaryCombineFn.html">Combine.BinaryCombineFn</a>
class that counts the sum of the number.</div>
</html>
Original file line number Diff line number Diff line change
Expand Up @@ -24,13 +24,13 @@ <h2>Combine - Combine PerKey</h2>
Combine PerKey transform. The combine function you supply to Combine PerKey must be an associative
reduction function or a subclass of CombineFn.</p>
<p>In this task, we are going to implement the sum of scores per player using
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/CombineFnBase.GlobalCombineFn.html">
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/CombineFnBase.GlobalCombineFn.html">
Combine.perKey</a>.
</p>
<br>
<br>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/CombineFnBase.GlobalCombineFn.html">Combine.perKey(GlobalCombineFn)</a>.</div>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/CombineFnBase.GlobalCombineFn.html">Combine.perKey(GlobalCombineFn)</a>.</div>
<div class='hint'>Extend the
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Combine.BinaryCombineFn.html">Combine.BinaryCombineFn</a>
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Combine.BinaryCombineFn.html">Combine.BinaryCombineFn</a>
class that counts the sum of the number.</div>
</html>
Original file line number Diff line number Diff line change
Expand Up @@ -30,12 +30,12 @@ <h2>Combine - CombineFn</h2>
function requires a more sophisticated accumulator, must perform additional pre- or
post-processing, might change the output type, or takes the key into account.</p>
<p>In this task, we are going to implement the average of numbers using
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Combine.CombineFn.html">
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Combine.CombineFn.html">
Combine.CombineFn</a>.
</p>
<br>
<br>
<div class='hint'>Extend the
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Combine.CombineFn.html">Combine.CombineFn</a>
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Combine.CombineFn.html">Combine.CombineFn</a>
class that counts the average of the number.</div>
</html>
Original file line number Diff line number Diff line change
Expand Up @@ -27,12 +27,12 @@ <h2>Combine - Simple Function</h2>
the value collection.</p>
<p>Simple combine operations, such as sums, can usually be implemented as a simple function.</p>
<p>In this task, we are going to implement the summation of numbers using
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/SerializableFunction.html">
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/SerializableFunction.html">
Combine.globally(SerializableFunction)</a>.
</p>
<br>
<br>
<div class='hint'>Implement the
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/SerializableFunction.html#apply-InputT-">SerializableFunction.apply</a>
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/SerializableFunction.html#apply-InputT-">SerializableFunction.apply</a>
method that performs the summation of the Iterable.</div>
</html>
4 changes: 2 additions & 2 deletions learning/katas/java/Core Transforms/Flatten/Flatten/task.html
Original file line number Diff line number Diff line change
Expand Up @@ -21,12 +21,12 @@ <h2>Flatten</h2>
<p>Flatten is a Beam transform for PCollection objects that store the same data type.
Flatten merges multiple PCollection objects into a single logical PCollection.</p>
<p>In this task, we are going to implement a
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Flatten.html">
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Flatten.html">
Flatten</a> transform that merges two PCollection of words into a single PCollection.
</p>
<br>
<br>
<div class='hint'>Refer to
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Flatten.html">Flatten</a>
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Flatten.html">Flatten</a>
to solve this problem.</div>
</html>
Original file line number Diff line number Diff line change
Expand Up @@ -24,12 +24,12 @@ <h2>GroupByKey</h2>
but different values. Given such a collection, you use GroupByKey to collect all of the values associated with each
unique key.</p>
<p>In this task, we are going to implement a
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/GroupByKey.html">
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/GroupByKey.html">
GroupByKey</a> transform that groups words by its first letter.
</p>
<br>
<br>
<div class='hint'>Refer to <a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/values/KV.html">KV</a>
and <a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/GroupByKey.html">GroupByKey</a>
<div class='hint'>Refer to <a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/values/KV.html">KV</a>
and <a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/GroupByKey.html">GroupByKey</a>
to solve this problem.</div>
</html>
Original file line number Diff line number Diff line change
Expand Up @@ -21,12 +21,12 @@ <h2>FlatMapElements</h2>
<p>The Beam SDKs provide language-specific ways to simplify how you provide your DoFn implementation.</p>
<p>FlatMapElements can be used to simplify DoFn that maps an element to multiple elements (one to many).</p>
<p>In this task, we are going to implement a function that maps each input sentence into words tokenized by whitespace (" ") using
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/FlatMapElements.html">
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/FlatMapElements.html">
FlatMapElements.into(...).via(...)</a>.
</p>
<br>
<br>
<div class='hint'>Use
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/FlatMapElements.html">FlatMapElements.into(...).via(...)</a>
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/FlatMapElements.html">FlatMapElements.into(...).via(...)</a>
</div>
</html>
4 changes: 2 additions & 2 deletions learning/katas/java/Core Transforms/Map/MapElements/task.html
Original file line number Diff line number Diff line change
Expand Up @@ -21,10 +21,10 @@ <h2>MapElements</h2>
<p>The Beam SDKs provide language-specific ways to simplify how you provide your DoFn implementation.</p>
<p>MapElements can be used to simplify DoFn that maps an element to another element (one to one).</p>
<p>In this task, we are going to implement a simple map function that multiplies all input elements by 5 using
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/MapElements.html">
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/MapElements.html">
MapElements.into(...).via(...)</a>.
</p>
<br>
<br>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/MapElements.html">MapElements.into(...).via(...)</a></div>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/MapElements.html">MapElements.into(...).via(...)</a></div>
</html>
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,6 @@ <h2>ParDo OneToMany</h2>
<br>
<br>
<div class='hint'>Hint: You can call DoFn.ProcessContext.output(..) multiple times in a
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/ParDo.html">ParDo</a>.
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/ParDo.html">ParDo</a>.
</div>
</html>
4 changes: 2 additions & 2 deletions learning/katas/java/Core Transforms/Map/ParDo/task.html
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,6 @@ <h2>ParDo</h2>
<p>For this task, please write a simple ParDo that maps the input element by multiplying it by 10.</p>
<br>
<br>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/ParDo.html">ParDo</a>
with <a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/DoFn.html">DoFn</a></div>
<div class='hint'>Use <a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/ParDo.html">ParDo</a>
with <a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/DoFn.html">DoFn</a></div>
</html>
Original file line number Diff line number Diff line change
Expand Up @@ -24,15 +24,15 @@ <h2>Partition</h2>
that you provide. The partitioning function contains the logic that determines how to split up
the elements of the input PCollection into each resulting partition PCollection.</p>
<p>In this task, we are going to implement a
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Partition.html">
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Partition.html">
Partition</a> transform that splits a PCollection of numbers into two PCollections.
The first PCollection contains numbers greater than 100, and the second PCollection contains
the remaining numbers.
</p>
<br>
<br>
<div class='hint'>Refer to
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Partition.html">Partition</a>
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Partition.html">Partition</a>
to solve this problem.
</div>
</html>
Original file line number Diff line number Diff line change
Expand Up @@ -40,6 +40,6 @@ <h2>Hello Beam Pipeline</h2>
<br>
<br>
<div class='hint'>Hardcoded input can be created using
<a href="https://beam.apache.org/releases/javadoc/2.11.0/org/apache/beam/sdk/transforms/Create.html">Create</a>
<a href="https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/transforms/Create.html">Create</a>
</div>
</html>
2 changes: 1 addition & 1 deletion learning/katas/java/build.gradle
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@

buildscript {
ext {
beamVersion = '2.11.0'
beamVersion = '2.12.0'
guavaVersion = '27.0-jre'
jodaTimeVersion = '2.10.1'
slf4jVersion = '1.7.25'
Expand Down
Loading

0 comments on commit f50e7d0

Please sign in to comment.