Skip to content

HBASE-26541 hbase-protocol-shaded not buildable on M1 MacOSX - #3922

Closed
apurtell wants to merge 1 commit into
apache:masterfrom
apurtell:HBASE-26541
Closed

HBASE-26541 hbase-protocol-shaded not buildable on M1 MacOSX#3922
apurtell wants to merge 1 commit into
apache:masterfrom
apurtell:HBASE-26541

Conversation

@apurtell

@apurtellapurtell commented Dec 6, 2021

Copy link
Copy Markdown
Contributor

I needed to make some changes to get hbase-protocol-shaded building on an M1 mac.

  • Upgrade internal.protobuf.version to 3.17.3.

@apurtellapurtell changed the title HBASE-26541 hbase-shaded-protobuf not buildable on M1 MacOSXHBASE-26541 hbase-protocol-shaded not buildable on M1 MacOSXDec 6, 2021
@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 5sDocker mode activated.
-0 ⚠️yetus0m 3sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 💚mvninstall4m 30smaster passed
+1 💚compile0m 50smaster passed
+1 💚shadedjars9m 14sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 14smaster passed
_ Patch Compile Tests _
+1 💚mvninstall4m 17sthe patch passed
+1 💚compile0m 49sthe patch passed
+1 💚javac0m 49sthe patch passed
-1 ❌shadedjars3m 22spatch has 10 errors when building our shaded downstream artifacts.
+1 💚javadoc0m 13sthe patch passed
_ Other Tests _
+1 💚unit0m 49shbase-protocol-shaded in the patch passed.
26m 35s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR#3922
Optional Testsjavac javadoc unit shadedjars compile
unameLinux 277c704b2920 4.15.0-147-generic #151-Ubuntu SMP Fri Jun 18 19:21:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / d9315fa
Default JavaAdoptOpenJDK-1.8.0_282-b08
shadedjarshttps://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/1/artifact/yetus-jdk8-hadoop3-check/output/patch-shadedjars.txt
Test Resultshttps://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/1/testReport/
Max. process+thread count65 (vs. ulimit of 30000)
modulesC: hbase-protocol-shaded U: hbase-protocol-shaded
Console outputhttps://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/1/console
versionsgit=2.17.1 maven=3.6.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 20sDocker mode activated.
-0 ⚠️yetus0m 3sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 💚mvninstall5m 53smaster passed
+1 💚compile1m 8smaster passed
+1 💚shadedjars9m 38sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 16smaster passed
_ Patch Compile Tests _
+1 💚mvninstall5m 39sthe patch passed
+1 💚compile1m 15sthe patch passed
+1 💚javac1m 15sthe patch passed
-1 ❌shadedjars3m 49spatch has 10 errors when building our shaded downstream artifacts.
+1 💚javadoc0m 15sthe patch passed
_ Other Tests _
+1 💚unit1m 11shbase-protocol-shaded in the patch passed.
31m 43s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR#3922
Optional Testsjavac javadoc unit shadedjars compile
unameLinux c41cd44a266b 4.15.0-142-generic #146-Ubuntu SMP Tue Apr 13 01:11:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / d9315fa
Default JavaAdoptOpenJDK-11.0.10+9
shadedjarshttps://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/1/artifact/yetus-jdk11-hadoop3-check/output/patch-shadedjars.txt
Test Resultshttps://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/1/testReport/
Max. process+thread count78 (vs. ulimit of 30000)
modulesC: hbase-protocol-shaded U: hbase-protocol-shaded
Console outputhttps://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/1/console
versionsgit=2.17.1 maven=3.6.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 27sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗prototool0m 1sprototool was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
_ master Compile Tests _
+1 💚mvninstall4m 16smaster passed
+1 💚compile1m 29smaster passed
_ Patch Compile Tests _
+1 💚mvninstall3m 48sthe patch passed
+1 💚compile1m 31sthe patch passed
+1 💚cc1m 31sthe patch passed
+1 💚javac1m 31sthe patch passed
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚xml0m 1sThe patch has no ill-formed XML file.
+1 💚hadoopcheck19m 28sPatch does not cause any errors with Hadoop 3.1.2 3.2.2 3.3.1.
+1 💚hbaseprotoc0m 58sthe patch passed
_ Other Tests _
-1 ❌asflicense0m 16sThe patch generated 1 ASF License warnings.
40m 34s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#3922
Optional Testsdupname asflicense javac hadoopcheck xml compile cc hbaseprotoc prototool
unameLinux b1dc2cec6258 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / d9315fa
Default JavaAdoptOpenJDK-1.8.0_282-b08
asflicensehttps://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/1/artifact/yetus-general-check/output/patch-asflicense-problems.txt
Max. process+thread count95 (vs. ulimit of 30000)
modulesC: hbase-protocol-shaded U: hbase-protocol-shaded
Console outputhttps://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/1/console
versionsgit=2.17.1 maven=3.6.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache9

Copy link
Copy Markdown
Contributor

I replied on jira, we need more information on the failure message, as at least we do have the any.proto in the shaded protobuf jar...

@apurtell

apurtell commented Dec 7, 2021

Copy link
Copy Markdown
ContributorAuthor

See https://issues.apache.org/jira/browse/HBASE-26541?focusedCommentId=17454738&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17454738

Going through this again (first I rm -rf ~/.m2/repository/com/google), it seems just the version change is enough. I have updated the PRs.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 30sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚@author0m 0sThe patch does not contain any @author tags.
_ master Compile Tests _
+0 🆗mvndep0m 17sMaven dependency ordering for branch
+1 💚mvninstall4m 44smaster passed
+1 💚compile2m 15smaster passed
_ Patch Compile Tests _
+0 🆗mvndep0m 16sMaven dependency ordering for patch
+1 💚mvninstall4m 3sthe patch passed
+1 💚compile2m 9sthe patch passed
+1 💚javac2m 9sthe patch passed
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚xml0m 3sThe patch has no ill-formed XML file.
+1 💚hadoopcheck19m 56sPatch does not cause any errors with Hadoop 3.1.2 3.2.2 3.3.1.
_ Other Tests _
+1 💚asflicense0m 25sThe patch does not generate ASF License warnings.
42m 43s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/2/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#3922
Optional Testsdupname asflicense javac hadoopcheck xml compile
unameLinux b62252a50260 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / ca3ba49
Default JavaAdoptOpenJDK-1.8.0_282-b08
Max. process+thread count96 (vs. ulimit of 30000)
modulesC: hbase-protocol-shaded hbase-examples U: .
Console outputhttps://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/2/console
versionsgit=2.17.1 maven=3.6.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 31sDocker mode activated.
-0 ⚠️yetus0m 3sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+0 🆗mvndep0m 16sMaven dependency ordering for branch
+1 💚mvninstall5m 20smaster passed
+1 💚compile1m 27smaster passed
+1 💚shadedjars10m 34sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 43smaster passed
_ Patch Compile Tests _
+0 🆗mvndep0m 18sMaven dependency ordering for patch
+1 💚mvninstall5m 7sthe patch passed
+1 💚compile1m 24sthe patch passed
+1 💚javac1m 24sthe patch passed
+1 💚shadedjars10m 32spatch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 44sthe patch passed
_ Other Tests _
+1 💚unit0m 58shbase-protocol-shaded in the patch passed.
+1 💚unit2m 39shbase-examples in the patch passed.
42m 50s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/2/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR#3922
Optional Testsjavac javadoc unit shadedjars compile
unameLinux 84d96fd4a62c 4.15.0-147-generic #151-Ubuntu SMP Fri Jun 18 19:21:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / ca3ba49
Default JavaAdoptOpenJDK-1.8.0_282-b08
Test Resultshttps://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/2/testReport/
Max. process+thread count1847 (vs. ulimit of 30000)
modulesC: hbase-protocol-shaded hbase-examples U: .
Console outputhttps://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/2/console
versionsgit=2.17.1 maven=3.6.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 35sDocker mode activated.
-0 ⚠️yetus0m 3sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+0 🆗mvndep0m 17sMaven dependency ordering for branch
+1 💚mvninstall6m 35smaster passed
+1 💚compile1m 55smaster passed
+1 💚shadedjars12m 4sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 44smaster passed
_ Patch Compile Tests _
+0 🆗mvndep0m 20sMaven dependency ordering for patch
+1 💚mvninstall6m 6sthe patch passed
+1 💚compile1m 54sthe patch passed
+1 💚javac1m 54sthe patch passed
+1 💚shadedjars11m 48spatch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 43sthe patch passed
_ Other Tests _
+1 💚unit1m 19shbase-protocol-shaded in the patch passed.
+1 💚unit1m 52shbase-examples in the patch passed.
47m 32s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR#3922
Optional Testsjavac javadoc unit shadedjars compile
unameLinux add5f81a90c1 4.15.0-156-generic #163-Ubuntu SMP Thu Aug 19 23:31:58 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / ca3ba49
Default JavaAdoptOpenJDK-11.0.10+9
Test Resultshttps://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/2/testReport/
Max. process+thread count2086 (vs. ulimit of 30000)
modulesC: hbase-protocol-shaded hbase-examples U: .
Console outputhttps://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-3922/2/console
versionsgit=2.17.1 maven=3.6.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@apurtell

Copy link
Copy Markdown
ContributorAuthor

This is required for compilation of HBase sources on Mac aarch64. I am committing this because as a committer I am entitled to a code base that will compile for me. Revert if you disagree.

@apurtellapurtell closed this Dec 9, 2021
@Apache9

Copy link
Copy Markdown
Contributor

Ah, sorry to be late here. I'm +1 on this PR. Thanks Andrew for fixing this on M1. I think there will be more and more developers using M1 MBP to it is important to make sure hbase can work on it.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@apurtell@Apache-HBase@Apache9