Skip to content

Commit

Permalink
[FLINK-10249][docs] Document hadoop/presto s3 file system configurati…
Browse files Browse the repository at this point in the history
…on forwarding
  • Loading branch information
sjwiesman authored and StephanEwen committed May 10, 2019
1 parent 4dae94d commit 7d45b75
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 4 deletions.
4 changes: 2 additions & 2 deletions docs/ops/filesystems/s3.md
Original file line number Diff line number Diff line change
Expand Up @@ -64,10 +64,10 @@ There is no need to add Hadoop to the classpath to use them.
Both internally use some Hadoop code, but "shade away" all classes to avoid any dependency conflicts.

- `flink-s3-fs-presto`, registered under the scheme *"s3:https://"* and *"s3p:https://"*, is based on code from the [Presto project](https://prestodb.io/).
You can configure it the same way you can [configure the Presto file system](https://prestodb.io/docs/0.187/connector/hive.html#amazon-s3-configuration).
You can configure it the same way you can [configure the Presto file system](https://prestodb.io/docs/0.187/connector/hive.html#amazon-s3-configuration) by placing adding the configurations to your `flink-conf.yaml`.

- `flink-s3-fs-hadoop`, registered under *"s3:https://"* and *"s3a:https://"*, based on code from the [Hadoop Project](https://hadoop.apache.org/).
The file system can be [configured exactly like Hadoop's s3a](https://hadoop.apache.org/docs/stable/hadoop-aws/tools/hadoop-aws/index.html#S3A).
The file system can be [configured exactly like Hadoop's s3a](https://hadoop.apache.org/docs/stable/hadoop-aws/tools/hadoop-aws/index.html#S3A) by placing adding the configurations to your `flink-conf.yaml`.

Both `flink-s3-fs-hadoop` and `flink-s3-fs-presto` register default FileSystem
wrappers for URIs with the `s3:https://` scheme, `flink-s3-fs-hadoop` also registers
Expand Down
4 changes: 2 additions & 2 deletions docs/ops/filesystems/s3.zh.md
Original file line number Diff line number Diff line change
Expand Up @@ -64,10 +64,10 @@ There is no need to add Hadoop to the classpath to use them.
Both internally use some Hadoop code, but "shade away" all classes to avoid any dependency conflicts.

- `flink-s3-fs-presto`, registered under the scheme *"s3:https://"* and *"s3p:https://"*, is based on code from the [Presto project](https://prestodb.io/).
You can configure it the same way you can [configure the Presto file system](https://prestodb.io/docs/0.187/connector/hive.html#amazon-s3-configuration).
You can configure it the same way you can [configure the Presto file system](https://prestodb.io/docs/0.187/connector/hive.html#amazon-s3-configuration) by placing adding the configurations to your `flink-conf.yaml`.

- `flink-s3-fs-hadoop`, registered under *"s3:https://"* and *"s3a:https://"*, based on code from the [Hadoop Project](https://hadoop.apache.org/).
The file system can be [configured exactly like Hadoop's s3a](https://hadoop.apache.org/docs/stable/hadoop-aws/tools/hadoop-aws/index.html#S3A).
The file system can be [configured exactly like Hadoop's s3a](https://hadoop.apache.org/docs/stable/hadoop-aws/tools/hadoop-aws/index.html#S3A) by placing adding the configurations to your `flink-conf.yaml`.

Both `flink-s3-fs-hadoop` and `flink-s3-fs-presto` register default FileSystem
wrappers for URIs with the `s3:https://` scheme, `flink-s3-fs-hadoop` also registers
Expand Down

0 comments on commit 7d45b75

Please sign in to comment.