Skip to content

Commit

Permalink
[FLINK-12493] Add step to export Hadoop classpath to docs
Browse files Browse the repository at this point in the history
Github PR apache#8422
  • Loading branch information
a-romero authored and aljoscha committed May 13, 2019
1 parent d1542e9 commit 518616e
Showing 1 changed file with 7 additions and 1 deletion.
8 changes: 7 additions & 1 deletion docs/ops/deployment/aws.md
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,13 @@ when creating an EMR cluster.
After creating your cluster, you can [connect to the master node](http:https://docs.aws.amazon.com/ElasticMapReduce/latest/ManagementGuide/emr-connect-master-node.html) and install Flink:

1. Go the [Downloads Page]({{ site.download_url }}) and **download a binary version of Flink matching the Hadoop version** of your EMR cluster, e.g. Hadoop 2.7 for EMR releases 4.3.0, 4.4.0, or 4.5.0.
2. Extract the Flink distribution and you are ready to deploy [Flink jobs via YARN](yarn_setup.html) after **setting the Hadoop config directory**:
2. Make sure all the Hadoop dependencies are in the classpath before you submit any jobs to EMR:

{% highlight bash %}
export HADOOP_CLASSPATH=`hadoop classpath`
{% endhighlight %}

3. Extract the Flink distribution and you are ready to deploy [Flink jobs via YARN](yarn_setup.html) after **setting the Hadoop config directory**:

{% highlight bash %}
HADOOP_CONF_DIR=/etc/hadoop/conf ./bin/flink run -m yarn-cluster -yn 1 examples/streaming/WordCount.jar
Expand Down

0 comments on commit 518616e

Please sign in to comment.