Skip to content

HBASE-24148: Upgrade Thrift to 0.13.0 - #1462

Closed
tamaashu wants to merge 1 commit into
apache:masterfrom
tamaashu:HBASE-24148
Closed

HBASE-24148: Upgrade Thrift to 0.13.0#1462
tamaashu wants to merge 1 commit into
apache:masterfrom
tamaashu:HBASE-24148

Conversation

@tamaashu

Copy link
Copy Markdown
Contributor

Upgrade thrift, adopt Java code where needed.

Change-Id: I8d78f6bd04ed3c7787b8f9beaf370dfdac9574cb

Upgrade thrift, adopt Java code where needed.
Change-Id: I8d78f6bd04ed3c7787b8f9beaf370dfdac9574cb
@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 30sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
_ master Compile Tests _
+0 🆗mvndep0m 44sMaven dependency ordering for branch
-1 ❌mvninstall4m 16sroot in master failed.
-0 ⚠️checkstyle2m 2sThe patch fails to run checkstyle in root
-1 ❌spotbugs7m 4sroot in master failed.
-1 ❌spotbugs0m 21shbase-mapreduce in master failed.
_ Patch Compile Tests _
+0 🆗mvndep0m 19sMaven dependency ordering for patch
+1 💚mvninstall5m 1sthe patch passed
-0 ⚠️checkstyle2m 19sroot: The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚xml0m 1sThe patch has no ill-formed XML file.
+1 💚hadoopcheck10m 22sPatch does not cause any errors with Hadoop 2.10.0 or 3.1.2.
+1 💚spotbugs13m 4sthe patch passed
_ Other Tests _
+1 💚asflicense0m 42sThe patch does not generate ASF License warnings.
55m 8s
SubsystemReport/Notes
DockerClient=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#1462
JIRA IssueHBASE-24148
Optional Testsdupname asflicense spotbugs hadoopcheck hbaseanti checkstyle xml
unameLinux 51ee3e438b13 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / eb7df04
mvninstallhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-general-check/output/branch-mvninstall-root.txt
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-general-check/output//home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1462@2/yetus-general-check/output/maven-branch-checkstyle-root.txt
spotbugshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-general-check/output/branch-spotbugs-root.txt
spotbugshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-general-check/output/branch-spotbugs-hbase-mapreduce.txt
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-general-check/output/diff-checkstyle-root.txt
Max. process+thread count93 (vs. ulimit of 10000)
modulesC: hbase-mapreduce hbase-thrift . U: .
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/console
versionsgit=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) spotbugs=3.1.12
Powered byApache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 33sDocker mode activated.
-0 ⚠️yetus0m 2sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+0 🆗mvndep0m 43sMaven dependency ordering for branch
-1 ❌mvninstall4m 18sroot in master failed.
-1 ❌compile1m 48sroot in master failed.
-1 ❌shadedjars3m 55sbranch has 16 errors when building our shaded downstream artifacts.
-0 ⚠️javadoc1m 57sroot in master failed.
_ Patch Compile Tests _
+0 🆗mvndep0m 20sMaven dependency ordering for patch
+1 💚mvninstall5m 6sthe patch passed
+1 💚compile2m 51sthe patch passed
+1 💚javac2m 51sroot generated 0 new + 34 unchanged - 4 fixed = 34 total (was 38)
+1 💚shadedjars4m 28spatch has no errors when building our shaded downstream artifacts.
-0 ⚠️javadoc2m 36sroot generated 72 new + 15 unchanged - 0 fixed = 87 total (was 15)
_ Other Tests _
+1 💚unit163m 21sroot in the patch passed.
196m 18s
SubsystemReport/Notes
DockerClient=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR#1462
JIRA IssueHBASE-24148
Optional Testsjavac javadoc unit shadedjars compile
unameLinux a7e449387982 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / eb7df04
Default Java1.8.0_232
mvninstallhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-jdk8-hadoop2-check/output/branch-mvninstall-root.txt
compilehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-jdk8-hadoop2-check/output/branch-compile-root.txt
shadedjarshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-jdk8-hadoop2-check/output/branch-shadedjars.txt
javadochttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-jdk8-hadoop2-check/output/branch-javadoc-root.txt
javadochttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-jdk8-hadoop2-check/output/diff-javadoc-javadoc-root.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/testReport/
Max. process+thread count4446 (vs. ulimit of 10000)
modulesC: hbase-mapreduce hbase-thrift . U: .
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/console
versionsgit=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f)
Powered byApache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 9sDocker mode activated.
-0 ⚠️yetus0m 3sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+0 🆗mvndep0m 39sMaven dependency ordering for branch
-1 ❌mvninstall5m 42sroot in master failed.
-1 ❌compile2m 36sroot in master failed.
-1 ❌shadedjars4m 59sbranch has 16 errors when building our shaded downstream artifacts.
-0 ⚠️javadoc0m 19sroot in master failed.
-0 ⚠️javadoc0m 18shbase-mapreduce in master failed.
-0 ⚠️javadoc0m 56shbase-thrift in master failed.
_ Patch Compile Tests _
+0 🆗mvndep0m 18sMaven dependency ordering for patch
+1 💚mvninstall6m 47sthe patch passed
+1 💚compile4m 0sthe patch passed
+1 💚javac4m 0sroot generated 0 new + 34 unchanged - 4 fixed = 34 total (was 38)
+1 💚shadedjars5m 42spatch has no errors when building our shaded downstream artifacts.
-0 ⚠️javadoc0m 19shbase-mapreduce in the patch failed.
-0 ⚠️javadoc0m 56shbase-thrift in the patch failed.
-0 ⚠️javadoc0m 18sroot in the patch failed.
_ Other Tests _
+1 💚unit247m 43sroot in the patch passed.
285m 10s
SubsystemReport/Notes
DockerClient=19.03.8 Server=19.03.8 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR#1462
JIRA IssueHBASE-24148
Optional Testsjavac javadoc unit shadedjars compile
unameLinux ebb093013a07 4.15.0-91-generic #92-Ubuntu SMP Fri Feb 28 11:09:48 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / eb7df04
Default Java2020-01-14
mvninstallhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-jdk11-hadoop3-check/output/branch-mvninstall-root.txt
compilehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-jdk11-hadoop3-check/output/branch-compile-root.txt
shadedjarshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-jdk11-hadoop3-check/output/branch-shadedjars.txt
javadochttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-root.txt
javadochttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-mapreduce.txt
javadochttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-thrift.txt
javadochttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-mapreduce.txt
javadochttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-thrift.txt
javadochttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-root.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/testReport/
Max. process+thread count3383 (vs. ulimit of 10000)
modulesC: hbase-mapreduce hbase-thrift . U: .
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1462/1/console
versionsgit=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f)
Powered byApache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

conf.setInt("mapreduce.map.maxattempts", 3);
TestExportSnapshot.testExportFileSystemState(conf, tableName,
Bytes.toBytes(snapshotName), Bytes.toBytes(snapshotName),
TestExportSnapshot.testExportFileSystemState(conf, tableName, snapshotName, snapshotName,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please resolve conflicts, this one is taken care of.
Thanks

Comment threadpom.xml
<protobuf.plugin.version>0.6.1</protobuf.plugin.version>
<thrift.path>thrift</thrift.path>
<thrift.version>0.12.0</thrift.version>
<thrift.version>0.13.0</thrift.version>

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What are the guarantees regards thrift 0.13 talking to a 0.12 server and vice-versa? Needs callout in the release notes on this JIRA at least.

Otherwise patch is good.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, do you have to regenerate the thrift files with this update? Will that happen as part of the build? (I forgot how this works)

@saintstack

saintstack commented Apr 15, 2020

Copy link
Copy Markdown
Contributor

Closing. Wrapped @tamaashu 's patch into a fatter one in a new PR that includes regeneration of java files from thrift IDLs. See #1519

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@tamaashu@Apache-HBase@saintstack@virajjasani