Skip to content

Al-assad/flink-shaded-hadoop

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Shaded Hadoop Dependencies for Flink


This repository contains a number of shaded Hadoop dependencies for the Apache Flink project, based on release-10.0 branch of apache/flink-shaded project.

The project supports Hadoop-2 and Hadoop-3 , including the following shaded subprojects:

  • flink-shaded-hadoop: Contains the main shaded Hadoop dependenices used by Flink .
  • flink-shaded-hadoop-uber: Uber-shaded project of flink-shaded-hadoop.
  • flink-shaded-hadoop-hive: Contains the main shaded Hadoop and. Hive dependenices used by Flink .

Build Shaded Hadoop JAR

git clone https://github.com/Al-assad/flink-shaded-hadoop.git
cd ./flink-shaded-hadoop
mvn clean install

Default Version:

  • Hadoop-3.1.1
  • Hive-3.1.1

Custom Hadoop/Hive Version

# use hadoop-3.1.0 and hive-3.1.0
mvn clean install -Dhadoop.version=3.1.0 -Dhive.version=3.1.0

About

Apache Flink is an open source project of The Apache Software Foundation (ASF).

About

Apache Flink shaded hadoop artifacts repository

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published