Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BIGTOP-3930. Fix deployment failure on Ubuntu 22.04 due to unavailable dependency on python. #1114

Merged
merged 1 commit into from
Jun 27, 2023

Conversation

iwasakims
Copy link
Member

https://issues.apache.org/jira/browse/BIGTOP-3930

  • added alternative dependency to python2.
  • added manifest to use /usr/bin/python pointing to python2 on Ubuntu 22.04.

@guyuqi
Copy link
Member

guyuqi commented Jun 2, 2023

Thank you for working on fixing these critical issues. Let me test it on Arm64.

@guyuqi
Copy link
Member

guyuqi commented Jun 5, 2023

It’s noticed that Ambari and YCSB seem to be having trouble building on x86 and Arm:

Ambari:

[INFO] --- exec-maven-plugin:1.2.1:exec (Bower install) @ ambari-admin ---
bower angular-translate#* CERT_HAS_EXPIRED Request to https://registry.bower.io/packages/angular-translate failed: certificate has expired
....
..
.
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec (Bower install) on project ambari-admin: Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]

YCSB:
[ERROR] Failed to execute goal on project maprdb-binding: Could not resolve dependencies for project site.ycsb:maprdb-binding:jar:0.17.0: Failed to collect dependencies at org.apache.hbase:hbase-client:jar:1.1.8-mapr-1710: Failed to read artifact descriptor for org.apache.hbase:hbase-client:jar:1.1.8-mapr-1710: Could not transfer artifact org.apache.hbase:hbase-client:pom:1.1.8-mapr-1710 from/to mapr-releases (https://repository.mapr.com/maven/): Transfer failed for https://repository.mapr.com/maven/org/apache/hbase/hbase-client/1.1.8-mapr-1710/hbase-client-1.1.8-mapr-1710.pom 500 Proxy Error -> [Help 1]

@iwasakims
Copy link
Member Author

iwasakims commented Jun 5, 2023

The cause is error of network or server on downloading dependencies. It is not related to Ubuntu specific package dependency. Feel free to file another JIRA if it is reproducible. @guyuqi

@guyuqi
Copy link
Member

guyuqi commented Jun 6, 2023

I'll file a ticket to fix the ycsb issues.

@iwasakims
Copy link
Member Author

@guyuqi issues of Ambari and YCSB are resolved. Are you OK to move this forward?

@pan3793
Copy link
Member

pan3793 commented Jun 14, 2023

The next Ubuntu drops python2, how many python scripts need to migrate in this project?

@iwasakims
Copy link
Member Author

@pan3793 The next Ubuntu is out of scope of this PR. Please file a JIRA issue or use dev-ML if you want.

@iwasakims iwasakims requested a review from sekikn June 27, 2023 01:03
Copy link
Contributor

@sekikn sekikn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, tested Hive on Ubuntu 22.04 with $ ./docker-hadoop.sh -d -dcp -C config_ubuntu-22.04.yaml -F docker-compose-cgroupv2.yml -G -L -k hdfs,yarn,hive -c 1. Thanks @iwasakims.

@sekikn sekikn merged commit becee0b into apache:master Jun 27, 2023
iwasakims added a commit that referenced this pull request Jun 27, 2023
…e dependency on python. (#1114)

(cherry picked from commit becee0b)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants