Skip to content

HBASE-22634 : Improve performance of BufferedMutator - #343

Closed
sbarnoud wants to merge 3 commits into
apache:branch-2.1from
sbarnoud:branch-2.1
Closed

HBASE-22634 : Improve performance of BufferedMutator #343
sbarnoud wants to merge 3 commits into
apache:branch-2.1from
sbarnoud:branch-2.1

Conversation

@sbarnoud

Copy link
Copy Markdown

As requested in the Jira HBASE-22634

@sbarnoudsbarnoud changed the title HBASE-22634.001.branch-2.1HBASE-22634 : Improve performance of BufferedMutator Jun 26, 2019
@busbey

Copy link
Copy Markdown
Contributor

Is there something specific to branch-2.1 for this that makes it irrelevant or substantively different for the master branch?

@sbarnoud

sbarnoud commented Jun 26, 2019 via email

Copy link
Copy Markdown
Author

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec53Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall376branch-2.1 passed
+1compile31branch-2.1 passed
+1checkstyle42branch-2.1 passed
+1shadedjars330branch has no errors when building our shaded downstream artifacts.
+1findbugs84branch-2.1 passed
+1javadoc28branch-2.1 passed
_ Patch Compile Tests _
-1mvninstall113root in the patch failed.
+1compile30the patch passed
+1javac30the patch passed
-1checkstyle42hbase-client: The patch generated 158 new + 51 unchanged - 1 fixed = 209 total (was 52)
+1whitespace0The patch has no whitespace issues.
-1shadedjars171patch has 11 errors when building our shaded downstream artifacts.
-1hadoopcheck105The patch causes 11 errors with Hadoop v2.7.7.
-1hadoopcheck207The patch causes 11 errors with Hadoop v2.8.5.
-1hadoopcheck310The patch causes 11 errors with Hadoop v3.0.3.
-1hadoopcheck416The patch causes 11 errors with Hadoop v3.1.2.
-1findbugs94hbase-client generated 6 new + 0 unchanged - 0 fixed = 6 total (was 0)
+1javadoc27the patch passed
_ Other Tests _
-1unit32hbase-client in the patch failed.
+1asflicense12The patch does not generate ASF License warnings.
1973
ReasonTests
FindBugsmodule:hbase-client
org.apache.hadoop.hbase.client.AsyncRequestFutureImpl.sendMultiAction(Map, int, List, boolean) calls Thread.sleep() with a lock held At AsyncRequestFutureImpl.java:Thread.sleep() with a lock held At AsyncRequestFutureImpl.java:[line 592]
Inconsistent synchronization of org.apache.hadoop.hbase.client.BufferedMutatorImpl.writeBufferPeriodicFlushTimer; locked 50% of time Unsynchronized access at BufferedMutatorImpl.java:50% of time Unsynchronized access at BufferedMutatorImpl.java:[line 298]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.close() calls Thread.sleep() with a lock held At BufferedMutatorImpl.java:lock held At BufferedMutatorImpl.java:[line 251]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.doFlush(boolean) calls Thread.sleep() with a lock held At BufferedMutatorImpl.java:lock held At BufferedMutatorImpl.java:[line 368]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush() does not release lock on all paths At BufferedMutatorImpl.java:on all paths At BufferedMutatorImpl.java:[line 299]
Dead store to f in org.apache.hadoop.hbase.client.BufferedMutatorThreadPoolExecutor.beforeExecute(Thread, Runnable) At BufferedMutatorThreadPoolExecutor.java:org.apache.hadoop.hbase.client.BufferedMutatorThreadPoolExecutor.beforeExecute(Thread, Runnable) At BufferedMutatorThreadPoolExecutor.java:[line 86]
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/1/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 962ad3d2c112 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / a172b48
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
mvninstallhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/1/artifact/out/patch-mvninstall-root.txt
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/1/artifact/out/diff-checkstyle-hbase-client.txt
shadedjarshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/1/artifact/out/patch-shadedjars.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/1/artifact/out/patch-javac-2.7.7.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/1/artifact/out/patch-javac-2.8.5.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/1/artifact/out/patch-javac-3.0.3.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/1/artifact/out/patch-javac-3.1.2.txt
findbugshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/1/artifact/out/new-findbugs-hbase-client.html
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/1/artifact/out/patch-unit-hbase-client.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/1/testReport/
Max. process+thread count93 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/1/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

Comment threadhbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncProcess.java Outdated
@Apache9

Copy link
Copy Markdown
Contributor

If i didn’t mistake BufferedMutatorImpl doesn’t exist anymore on master. I build this on my cluster on a 2.1.4 ...

Le 26 juin 2019 à 20:00, Sean Busbey @.***> a écrit : Is there something specific to branch-2.1 for this that makes it irrelevant or substantively different for the master branch? — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or mute the thread.

Yes, it is gone on master. We reimplement the sync client based on async client on master so the BufferedMutator and AsyncProcess are both removed.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec161Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall306branch-2.1 passed
+1compile31branch-2.1 passed
+1checkstyle42branch-2.1 passed
+1shadedjars304branch has no errors when building our shaded downstream artifacts.
+1findbugs78branch-2.1 passed
+1javadoc27branch-2.1 passed
_ Patch Compile Tests _
-1mvninstall106root in the patch failed.
+1compile30the patch passed
+1javac30the patch passed
-1checkstyle44hbase-client: The patch generated 158 new + 51 unchanged - 1 fixed = 209 total (was 52)
+1whitespace0The patch has no whitespace issues.
-1shadedjars160patch has 11 errors when building our shaded downstream artifacts.
-1hadoopcheck96The patch causes 11 errors with Hadoop v2.7.7.
-1hadoopcheck198The patch causes 11 errors with Hadoop v2.8.5.
-1hadoopcheck299The patch causes 11 errors with Hadoop v3.0.3.
-1hadoopcheck401The patch causes 11 errors with Hadoop v3.1.2.
-1findbugs92hbase-client generated 6 new + 0 unchanged - 0 fixed = 6 total (was 0)
+1javadoc27the patch passed
_ Other Tests _
-1unit33hbase-client in the patch failed.
+1asflicense12The patch does not generate ASF License warnings.
1928
ReasonTests
FindBugsmodule:hbase-client
org.apache.hadoop.hbase.client.AsyncRequestFutureImpl.sendMultiAction(Map, int, List, boolean) calls Thread.sleep() with a lock held At AsyncRequestFutureImpl.java:Thread.sleep() with a lock held At AsyncRequestFutureImpl.java:[line 592]
Inconsistent synchronization of org.apache.hadoop.hbase.client.BufferedMutatorImpl.writeBufferPeriodicFlushTimer; locked 50% of time Unsynchronized access at BufferedMutatorImpl.java:50% of time Unsynchronized access at BufferedMutatorImpl.java:[line 298]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.close() calls Thread.sleep() with a lock held At BufferedMutatorImpl.java:lock held At BufferedMutatorImpl.java:[line 251]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.doFlush(boolean) calls Thread.sleep() with a lock held At BufferedMutatorImpl.java:lock held At BufferedMutatorImpl.java:[line 368]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush() does not release lock on all paths At BufferedMutatorImpl.java:on all paths At BufferedMutatorImpl.java:[line 299]
Dead store to f in org.apache.hadoop.hbase.client.BufferedMutatorThreadPoolExecutor.beforeExecute(Thread, Runnable) At BufferedMutatorThreadPoolExecutor.java:org.apache.hadoop.hbase.client.BufferedMutatorThreadPoolExecutor.beforeExecute(Thread, Runnable) At BufferedMutatorThreadPoolExecutor.java:[line 86]
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/2/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 734c932d4aec 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / a172b48
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
mvninstallhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/2/artifact/out/patch-mvninstall-root.txt
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/2/artifact/out/diff-checkstyle-hbase-client.txt
shadedjarshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/2/artifact/out/patch-shadedjars.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/2/artifact/out/patch-javac-2.7.7.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/2/artifact/out/patch-javac-2.8.5.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/2/artifact/out/patch-javac-3.0.3.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/2/artifact/out/patch-javac-3.1.2.txt
findbugshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/2/artifact/out/new-findbugs-hbase-client.html
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/2/artifact/out/patch-unit-hbase-client.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/2/testReport/
Max. process+thread count93 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/2/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec54Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall295branch-2.1 passed
+1compile30branch-2.1 passed
+1checkstyle41branch-2.1 passed
+1shadedjars297branch has no errors when building our shaded downstream artifacts.
+1findbugs74branch-2.1 passed
+1javadoc26branch-2.1 passed
_ Patch Compile Tests _
-1mvninstall106root in the patch failed.
+1compile30the patch passed
+1javac30the patch passed
-1checkstyle44hbase-client: The patch generated 158 new + 51 unchanged - 1 fixed = 209 total (was 52)
+1whitespace0The patch has no whitespace issues.
-1shadedjars161patch has 11 errors when building our shaded downstream artifacts.
-1hadoopcheck95The patch causes 11 errors with Hadoop v2.7.7.
-1hadoopcheck189The patch causes 11 errors with Hadoop v2.8.5.
-1hadoopcheck290The patch causes 11 errors with Hadoop v3.0.3.
-1hadoopcheck390The patch causes 11 errors with Hadoop v3.1.2.
-1findbugs92hbase-client generated 5 new + 0 unchanged - 0 fixed = 5 total (was 0)
+1javadoc26the patch passed
_ Other Tests _
-1unit32hbase-client in the patch failed.
+1asflicense12The patch does not generate ASF License warnings.
1784
ReasonTests
FindBugsmodule:hbase-client
org.apache.hadoop.hbase.client.AsyncRequestFutureImpl.sendMultiAction(Map, int, List, boolean) calls Thread.sleep() with a lock held At AsyncRequestFutureImpl.java:Thread.sleep() with a lock held At AsyncRequestFutureImpl.java:[line 592]
Inconsistent synchronization of org.apache.hadoop.hbase.client.BufferedMutatorImpl.writeBufferPeriodicFlushTimer; locked 46% of time Unsynchronized access at BufferedMutatorImpl.java:46% of time Unsynchronized access at BufferedMutatorImpl.java:[line 236]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.doFlush(boolean) calls Thread.sleep() with a lock held At BufferedMutatorImpl.java:lock held At BufferedMutatorImpl.java:[line 371]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush() does not release lock on all paths At BufferedMutatorImpl.java:on all paths At BufferedMutatorImpl.java:[line 302]
Dead store to f in org.apache.hadoop.hbase.client.BufferedMutatorThreadPoolExecutor.beforeExecute(Thread, Runnable) At BufferedMutatorThreadPoolExecutor.java:org.apache.hadoop.hbase.client.BufferedMutatorThreadPoolExecutor.beforeExecute(Thread, Runnable) At BufferedMutatorThreadPoolExecutor.java:[line 94]
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/3/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux e3789c53aae6 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / a172b48
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
mvninstallhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/3/artifact/out/patch-mvninstall-root.txt
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/3/artifact/out/diff-checkstyle-hbase-client.txt
shadedjarshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/3/artifact/out/patch-shadedjars.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/3/artifact/out/patch-javac-2.7.7.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/3/artifact/out/patch-javac-2.8.5.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/3/artifact/out/patch-javac-3.0.3.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/3/artifact/out/patch-javac-3.1.2.txt
findbugshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/3/artifact/out/new-findbugs-hbase-client.html
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/3/artifact/out/patch-unit-hbase-client.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/3/testReport/
Max. process+thread count96 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/3/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec31Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall237branch-2.1 passed
+1compile23branch-2.1 passed
+1checkstyle29branch-2.1 passed
+1shadedjars223branch has no errors when building our shaded downstream artifacts.
+1findbugs61branch-2.1 passed
+1javadoc22branch-2.1 passed
_ Patch Compile Tests _
-1mvninstall76root in the patch failed.
-1compile22hbase-client in the patch failed.
-1javac22hbase-client in the patch failed.
-1checkstyle34hbase-client: The patch generated 161 new + 61 unchanged - 1 fixed = 222 total (was 62)
+1whitespace0The patch has no whitespace issues.
-1shadedjars118patch has 14 errors when building our shaded downstream artifacts.
-1hadoopcheck70The patch causes 14 errors with Hadoop v2.7.7.
-1hadoopcheck140The patch causes 14 errors with Hadoop v2.8.5.
-1hadoopcheck214The patch causes 14 errors with Hadoop v3.0.3.
-1hadoopcheck285The patch causes 14 errors with Hadoop v3.1.2.
-1findbugs18hbase-client in the patch failed.
+1javadoc20the patch passed
_ Other Tests _
-1unit22hbase-client in the patch failed.
+1asflicense9The patch does not generate ASF License warnings.
1288
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/4/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 7223070aa198 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / a172b48
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
mvninstallhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/4/artifact/out/patch-mvninstall-root.txt
compilehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/4/artifact/out/patch-compile-hbase-client.txt
javachttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/4/artifact/out/patch-compile-hbase-client.txt
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/4/artifact/out/diff-checkstyle-hbase-client.txt
shadedjarshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/4/artifact/out/patch-shadedjars.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/4/artifact/out/patch-javac-2.7.7.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/4/artifact/out/patch-javac-2.8.5.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/4/artifact/out/patch-javac-3.0.3.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/4/artifact/out/patch-javac-3.1.2.txt
findbugshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/4/artifact/out/patch-findbugs-hbase-client.txt
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/4/artifact/out/patch-unit-hbase-client.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/4/testReport/
Max. process+thread count93 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/4/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec103Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall245branch-2.1 passed
+1compile24branch-2.1 passed
+1checkstyle33branch-2.1 passed
+1shadedjars239branch has no errors when building our shaded downstream artifacts.
+1findbugs62branch-2.1 passed
+1javadoc22branch-2.1 passed
_ Patch Compile Tests _
-1mvninstall84root in the patch failed.
+1compile25the patch passed
+1javac25the patch passed
-1checkstyle33hbase-client: The patch generated 18 new + 60 unchanged - 2 fixed = 78 total (was 62)
+1whitespace0The patch has no whitespace issues.
-1shadedjars120patch has 11 errors when building our shaded downstream artifacts.
-1hadoopcheck76The patch causes 11 errors with Hadoop v2.7.7.
-1hadoopcheck156The patch causes 11 errors with Hadoop v2.8.5.
-1hadoopcheck244The patch causes 11 errors with Hadoop v3.0.3.
-1hadoopcheck327The patch causes 11 errors with Hadoop v3.1.2.
-1findbugs70hbase-client generated 5 new + 0 unchanged - 0 fixed = 5 total (was 0)
+1javadoc24the patch passed
_ Other Tests _
-1unit27hbase-client in the patch failed.
+1asflicense11The patch does not generate ASF License warnings.
1515
ReasonTests
FindBugsmodule:hbase-client
org.apache.hadoop.hbase.client.AsyncRequestFutureImpl.sendMultiAction(Map, int, List, boolean) calls Thread.sleep() with a lock held At AsyncRequestFutureImpl.java:Thread.sleep() with a lock held At AsyncRequestFutureImpl.java:[line 592]
Inconsistent synchronization of org.apache.hadoop.hbase.client.BufferedMutatorImpl.writeBufferPeriodicFlushTimer; locked 46% of time Unsynchronized access at BufferedMutatorImpl.java:46% of time Unsynchronized access at BufferedMutatorImpl.java:[line 236]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.doFlush(boolean) calls Thread.sleep() with a lock held At BufferedMutatorImpl.java:lock held At BufferedMutatorImpl.java:[line 371]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush() does not release lock on all paths At BufferedMutatorImpl.java:on all paths At BufferedMutatorImpl.java:[line 302]
Dead store to f in org.apache.hadoop.hbase.client.BufferedMutatorThreadPoolExecutor.beforeExecute(Thread, Runnable) At BufferedMutatorThreadPoolExecutor.java:org.apache.hadoop.hbase.client.BufferedMutatorThreadPoolExecutor.beforeExecute(Thread, Runnable) At BufferedMutatorThreadPoolExecutor.java:[line 94]
SubsystemReport/Notes
DockerClient=18.09.5 Server=18.09.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/5/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 4a148600d077 4.15.0-48-generic #51-Ubuntu SMP Wed Apr 3 08:28:49 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / a172b48
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
mvninstallhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/5/artifact/out/patch-mvninstall-root.txt
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/5/artifact/out/diff-checkstyle-hbase-client.txt
shadedjarshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/5/artifact/out/patch-shadedjars.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/5/artifact/out/patch-javac-2.7.7.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/5/artifact/out/patch-javac-2.8.5.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/5/artifact/out/patch-javac-3.0.3.txt
hadoopcheckhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/5/artifact/out/patch-javac-3.1.2.txt
findbugshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/5/artifact/out/new-findbugs-hbase-client.html
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/5/artifact/out/patch-unit-hbase-client.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/5/testReport/
Max. process+thread count83 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/5/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec91Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall228branch-2.1 passed
+1compile24branch-2.1 passed
+1checkstyle33branch-2.1 passed
+1shadedjars238branch has no errors when building our shaded downstream artifacts.
+1findbugs75branch-2.1 passed
+1javadoc23branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall245the patch passed
+1compile25the patch passed
+1javac25the patch passed
-1checkstyle48hbase-client: The patch generated 18 new + 60 unchanged - 2 fixed = 78 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars318patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck997Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
-1findbugs74hbase-client generated 5 new + 0 unchanged - 0 fixed = 5 total (was 0)
+1javadoc23the patch passed
_ Other Tests _
-1unit113hbase-client in the patch failed.
+1asflicense10The patch does not generate ASF License warnings.
2898
ReasonTests
FindBugsmodule:hbase-client
org.apache.hadoop.hbase.client.AsyncRequestFutureImpl.sendMultiAction(Map, int, List, boolean) calls Thread.sleep() with a lock held At AsyncRequestFutureImpl.java:Thread.sleep() with a lock held At AsyncRequestFutureImpl.java:[line 592]
Inconsistent synchronization of org.apache.hadoop.hbase.client.BufferedMutatorImpl.writeBufferPeriodicFlushTimer; locked 46% of time Unsynchronized access at BufferedMutatorImpl.java:46% of time Unsynchronized access at BufferedMutatorImpl.java:[line 236]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.doFlush(boolean) calls Thread.sleep() with a lock held At BufferedMutatorImpl.java:lock held At BufferedMutatorImpl.java:[line 371]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush() does not release lock on all paths At BufferedMutatorImpl.java:on all paths At BufferedMutatorImpl.java:[line 302]
Dead store to f in org.apache.hadoop.hbase.client.BufferedMutatorThreadPoolExecutor.beforeExecute(Thread, Runnable) At BufferedMutatorThreadPoolExecutor.java:org.apache.hadoop.hbase.client.BufferedMutatorThreadPoolExecutor.beforeExecute(Thread, Runnable) At BufferedMutatorThreadPoolExecutor.java:[line 97]
Failed junit testshadoop.hbase.client.TestClientNoCluster
hadoop.hbase.client.TestBufferedMutator
hadoop.hbase.ipc.TestRpcClientDeprecatedNameMapping
SubsystemReport/Notes
DockerClient=18.09.5 Server=18.09.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/6/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux fdb87df5a7a2 4.15.0-48-generic #51-Ubuntu SMP Wed Apr 3 08:28:49 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / a172b48
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/6/artifact/out/diff-checkstyle-hbase-client.txt
findbugshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/6/artifact/out/new-findbugs-hbase-client.html
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/6/artifact/out/patch-unit-hbase-client.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/6/testReport/
Max. process+thread count94 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/6/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec26Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall218branch-2.1 passed
+1compile23branch-2.1 passed
+1checkstyle29branch-2.1 passed
+1shadedjars222branch has no errors when building our shaded downstream artifacts.
+1findbugs60branch-2.1 passed
+1javadoc21branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall222the patch passed
+1compile22the patch passed
+1javac22the patch passed
-1checkstyle30hbase-client: The patch generated 18 new + 60 unchanged - 2 fixed = 78 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars219patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck928Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
-1findbugs73hbase-client generated 5 new + 0 unchanged - 0 fixed = 5 total (was 0)
+1javadoc23the patch passed
_ Other Tests _
-1unit116hbase-client in the patch failed.
+1asflicense9The patch does not generate ASF License warnings.
2565
ReasonTests
FindBugsmodule:hbase-client
org.apache.hadoop.hbase.client.AsyncRequestFutureImpl.sendMultiAction(Map, int, List, boolean) calls Thread.sleep() with a lock held At AsyncRequestFutureImpl.java:Thread.sleep() with a lock held At AsyncRequestFutureImpl.java:[line 592]
Inconsistent synchronization of org.apache.hadoop.hbase.client.BufferedMutatorImpl.writeBufferPeriodicFlushTimer; locked 46% of time Unsynchronized access at BufferedMutatorImpl.java:46% of time Unsynchronized access at BufferedMutatorImpl.java:[line 236]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.doFlush(boolean) calls Thread.sleep() with a lock held At BufferedMutatorImpl.java:lock held At BufferedMutatorImpl.java:[line 371]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush() does not release lock on all paths At BufferedMutatorImpl.java:on all paths At BufferedMutatorImpl.java:[line 302]
Dead store to f in org.apache.hadoop.hbase.client.BufferedMutatorThreadPoolExecutor.beforeExecute(Thread, Runnable) At BufferedMutatorThreadPoolExecutor.java:org.apache.hadoop.hbase.client.BufferedMutatorThreadPoolExecutor.beforeExecute(Thread, Runnable) At BufferedMutatorThreadPoolExecutor.java:[line 97]
Failed junit testshadoop.hbase.client.TestBufferedMutator
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/7/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 7071126567ec 4.4.0-139-generic #165-Ubuntu SMP Wed Oct 24 10:58:50 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / 60097a6
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/7/artifact/out/diff-checkstyle-hbase-client.txt
findbugshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/7/artifact/out/new-findbugs-hbase-client.html
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/7/artifact/out/patch-unit-hbase-client.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/7/testReport/
Max. process+thread count104 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/7/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec57Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall291branch-2.1 passed
+1compile30branch-2.1 passed
+1checkstyle40branch-2.1 passed
+1shadedjars299branch has no errors when building our shaded downstream artifacts.
+1findbugs76branch-2.1 passed
+1javadoc28branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall282the patch passed
+1compile30the patch passed
+1javac30the patch passed
-1checkstyle40hbase-client: The patch generated 18 new + 60 unchanged - 2 fixed = 78 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars289patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1181Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
-1findbugs89hbase-client generated 5 new + 0 unchanged - 0 fixed = 5 total (was 0)
+1javadoc27the patch passed
_ Other Tests _
+1unit152hbase-client in the patch passed.
+1asflicense12The patch does not generate ASF License warnings.
3281
ReasonTests
FindBugsmodule:hbase-client
org.apache.hadoop.hbase.client.AsyncRequestFutureImpl.sendMultiAction(Map, int, List, boolean) calls Thread.sleep() with a lock held At AsyncRequestFutureImpl.java:Thread.sleep() with a lock held At AsyncRequestFutureImpl.java:[line 592]
Inconsistent synchronization of org.apache.hadoop.hbase.client.BufferedMutatorImpl.writeBufferPeriodicFlushTimer; locked 46% of time Unsynchronized access at BufferedMutatorImpl.java:46% of time Unsynchronized access at BufferedMutatorImpl.java:[line 239]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.doFlush(boolean) calls Thread.sleep() with a lock held At BufferedMutatorImpl.java:lock held At BufferedMutatorImpl.java:[line 374]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush() does not release lock on all paths At BufferedMutatorImpl.java:on all paths At BufferedMutatorImpl.java:[line 305]
Dead store to f in org.apache.hadoop.hbase.client.BufferedMutatorThreadPoolExecutor.beforeExecute(Thread, Runnable) At BufferedMutatorThreadPoolExecutor.java:org.apache.hadoop.hbase.client.BufferedMutatorThreadPoolExecutor.beforeExecute(Thread, Runnable) At BufferedMutatorThreadPoolExecutor.java:[line 97]
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/8/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux f948f8437b7a 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / 60097a6
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/8/artifact/out/diff-checkstyle-hbase-client.txt
findbugshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/8/artifact/out/new-findbugs-hbase-client.html
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/8/testReport/
Max. process+thread count273 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/8/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec26Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall225branch-2.1 passed
+1compile24branch-2.1 passed
+1checkstyle31branch-2.1 passed
+1shadedjars233branch has no errors when building our shaded downstream artifacts.
+1findbugs57branch-2.1 passed
+1javadoc23branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall225the patch passed
+1compile25the patch passed
+1javac25the patch passed
-1checkstyle34hbase-client: The patch generated 22 new + 60 unchanged - 2 fixed = 82 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars232patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck902Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
-1findbugs69hbase-client generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
+1javadoc21the patch passed
_ Other Tests _
+1unit124hbase-client in the patch passed.
+1asflicense9The patch does not generate ASF License warnings.
2550
ReasonTests
FindBugsmodule:hbase-client
Inconsistent synchronization of org.apache.hadoop.hbase.client.BufferedMutatorImpl.writeBufferPeriodicFlushTimer; locked 66% of time Unsynchronized access at BufferedMutatorImpl.java:66% of time Unsynchronized access at BufferedMutatorImpl.java:[line 239]
org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush() does not release lock on all paths At BufferedMutatorImpl.java:on all paths At BufferedMutatorImpl.java:[line 306]
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/9/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 6151dcaa9ff2 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / 60097a6
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/9/artifact/out/diff-checkstyle-hbase-client.txt
findbugshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/9/artifact/out/new-findbugs-hbase-client.html
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/9/testReport/
Max. process+thread count291 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/9/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec89Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall247branch-2.1 passed
+1compile25branch-2.1 passed
+1checkstyle37branch-2.1 passed
+1shadedjars243branch has no errors when building our shaded downstream artifacts.
+1findbugs61branch-2.1 passed
+1javadoc22branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall238the patch passed
+1compile25the patch passed
+1javac25the patch passed
-1checkstyle34hbase-client: The patch generated 23 new + 60 unchanged - 2 fixed = 83 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars236patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck984Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
-1findbugs75hbase-client generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1javadoc21the patch passed
_ Other Tests _
+1unit122hbase-client in the patch passed.
+1asflicense11The patch does not generate ASF License warnings.
2778
ReasonTests
FindBugsmodule:hbase-client
org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush() does not release lock on all paths At BufferedMutatorImpl.java:on all paths At BufferedMutatorImpl.java:[line 308]
SubsystemReport/Notes
DockerClient=18.09.5 Server=18.09.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/10/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 8856ded457b8 4.15.0-48-generic #51-Ubuntu SMP Wed Apr 3 08:28:49 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / 60097a6
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/10/artifact/out/diff-checkstyle-hbase-client.txt
findbugshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/10/artifact/out/new-findbugs-hbase-client.html
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/10/testReport/
Max. process+thread count259 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/10/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec37Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall346branch-2.1 passed
+1compile41branch-2.1 passed
+1checkstyle46branch-2.1 passed
+1shadedjars349branch has no errors when building our shaded downstream artifacts.
+1findbugs97branch-2.1 passed
+1javadoc32branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall337the patch passed
+1compile36the patch passed
+1javac36the patch passed
-1checkstyle42hbase-client: The patch generated 23 new + 60 unchanged - 2 fixed = 83 total (was 62)
+1whitespace1The patch has no whitespace issues.
+1shadedjars339patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1393Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
-1findbugs121hbase-client generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1javadoc31the patch passed
_ Other Tests _
+1unit199hbase-client in the patch passed.
+1asflicense14The patch does not generate ASF License warnings.
3877
ReasonTests
FindBugsmodule:hbase-client
org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush() does not release lock on all paths At BufferedMutatorImpl.java:on all paths At BufferedMutatorImpl.java:[line 308]
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/11/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 450412f14146 4.4.0-131-generic #157~14.04.1-Ubuntu SMP Fri Jul 13 08:53:17 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / 60097a6
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/11/artifact/out/diff-checkstyle-hbase-client.txt
findbugshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/11/artifact/out/new-findbugs-hbase-client.html
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/11/testReport/
Max. process+thread count157 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/11/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec161Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall225branch-2.1 passed
+1compile24branch-2.1 passed
+1checkstyle32branch-2.1 passed
+1shadedjars226branch has no errors when building our shaded downstream artifacts.
+1findbugs58branch-2.1 passed
+1javadoc22branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall217the patch passed
+1compile24the patch passed
+1javac24the patch passed
-1checkstyle31hbase-client: The patch generated 23 new + 60 unchanged - 2 fixed = 83 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars242patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck957Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1findbugs63the patch passed
+1javadoc21the patch passed
_ Other Tests _
+1unit124hbase-client in the patch passed.
+1asflicense12The patch does not generate ASF License warnings.
2724
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/12/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux f942801736f6 4.4.0-137-generic #163-Ubuntu SMP Mon Sep 24 13:14:43 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / 60097a6
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/12/artifact/out/diff-checkstyle-hbase-client.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/12/testReport/
Max. process+thread count289 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/12/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec30Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall321branch-2.1 passed
+1compile37branch-2.1 passed
+1checkstyle42branch-2.1 passed
+1shadedjars302branch has no errors when building our shaded downstream artifacts.
+1findbugs90branch-2.1 passed
+1javadoc31branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall318the patch passed
+1compile42the patch passed
+1javac42the patch passed
-1checkstyle48hbase-client: The patch generated 11 new + 57 unchanged - 5 fixed = 68 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars348patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1294Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1findbugs116the patch passed
+1javadoc33the patch passed
_ Other Tests _
+1unit207hbase-client in the patch passed.
+1asflicense12The patch does not generate ASF License warnings.
3680
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/13/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 40d1b804ea2c 4.4.0-131-generic #157~14.04.1-Ubuntu SMP Fri Jul 13 08:53:17 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / 4bb063f
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/13/artifact/out/diff-checkstyle-hbase-client.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/13/testReport/
Max. process+thread count155 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/13/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec33Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall233branch-2.1 passed
+1compile24branch-2.1 passed
+1checkstyle33branch-2.1 passed
+1shadedjars234branch has no errors when building our shaded downstream artifacts.
+1findbugs60branch-2.1 passed
+1javadoc22branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall224the patch passed
+1compile24the patch passed
+1javac24the patch passed
-1checkstyle31hbase-client: The patch generated 1 new + 56 unchanged - 6 fixed = 57 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars229patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1149Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1findbugs83the patch passed
+1javadoc25the patch passed
_ Other Tests _
+1unit141hbase-client in the patch passed.
+1asflicense10The patch does not generate ASF License warnings.
2906
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/14/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 8cb271eabcaf 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / 085ea6f
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/14/artifact/out/diff-checkstyle-hbase-client.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/14/testReport/
Max. process+thread count282 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/14/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec32Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall253branch-2.1 passed
+1compile26branch-2.1 passed
+1checkstyle32branch-2.1 passed
+1shadedjars246branch has no errors when building our shaded downstream artifacts.
+1findbugs65branch-2.1 passed
+1javadoc21branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall243the patch passed
+1compile26the patch passed
+1javac26the patch passed
+1checkstyle31hbase-client: The patch generated 0 new + 58 unchanged - 4 fixed = 58 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars242patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck974Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1findbugs72the patch passed
+1javadoc23the patch passed
_ Other Tests _
+1unit126hbase-client in the patch passed.
+1asflicense10The patch does not generate ASF License warnings.
2727
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/15/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux ef9e902a1c02 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / 085ea6f
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/15/testReport/
Max. process+thread count289 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/15/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec170Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall232branch-2.1 passed
+1compile23branch-2.1 passed
+1checkstyle32branch-2.1 passed
+1shadedjars233branch has no errors when building our shaded downstream artifacts.
+1findbugs60branch-2.1 passed
+1javadoc22branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall223the patch passed
+1compile25the patch passed
+1javac25the patch passed
+1checkstyle32hbase-client: The patch generated 0 new + 58 unchanged - 4 fixed = 58 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars233patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck932Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1findbugs68the patch passed
+1javadoc22the patch passed
_ Other Tests _
+1unit120hbase-client in the patch passed.
+1asflicense10The patch does not generate ASF License warnings.
2746
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/16/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 746581a4363a 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / 085ea6f
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/16/testReport/
Max. process+thread count287 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/16/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@sbarnoud

Copy link
Copy Markdown
Author

A spark job with 7 executors, 4 cores each, has an average throughput of more than 500000 insert/s with optimal tuning of:

  • hbase.client.write.buffer
  • hbase.htable.threads.max
  • hbase.client.max.total.tasks
  • hbase.client.max.perserver.tasks
  • hbase.client.ipc.pool.size
  • hbase.client.rpc.compressor (GzipCodec.class.getCanonicalName() seems to be always the best)

Where the input dataset is well balanced on the rowkey,on a table presplitted on 26 region servers, with a tiny average record size (500 bytes average).

The source of the Spark job is as simple as:

 df.toJavaRDD().foreachPartition(rows -> {
BufferedMutator.ExceptionListener listener = (e, mutator) -> {
for (int i = 0; i < e.getNumExceptions(); i++) {
log.warn("Failed to send put: " + e.getRow(i));
}
};
Configuration hadoopConf = HBaseConfiguration.create();
hadoopConf.set("hbase.client.write.buffer", options.getWriteBufferSize());
hadoopConf.set("hbase.client.max.perrequest.heapsize", options.getWriteBufferSize());
hadoopConf.set("hbase.htable.threads.keepalivetime", "60");
hadoopConf.set("hbase.client.max.total.tasks", options.getMaxTotalTasks());
hadoopConf.set("hbase.client.max.perserver.tasks", options.getMaxServerTasks());
hadoopConf.set("hbase.client.max.perregion.tasks", options.getMaxRegionTasks());
hadoopConf.set("hbase.htable.threads.max", options.getPoolSize());
hadoopConf.set("hbase.hconnection.threads.max", "1");
hadoopConf.set("hbase.hconnection.threads.core", "1");
hadoopConf.set("hbase.hconnection.meta.lookup.threads.max", "5");
hadoopConf.set("hbase.hconnection.meta.lookup.threads.core", "1");
hadoopConf.set("hbase.client.rpc.compressor", GzipCodec.class.getCanonicalName());
hadoopConf.set("hbase.client.ipc.pool.size",options.getIpcPoolSize());
// Use the same connection in each executor core
Connection connection = HBaseConnectionCache.getConnection(hadoopConf).connection();
TableName tableName = TableName.valueOf(options.getTable());
// If streaming, please modify that to reuse the pool.
BufferedMutatorThreadPoolExecutor pool = BufferedMutatorThreadPoolExecutor.getPoolExecutor(hadoopConf);
BufferedMutatorParams mutatorParms = new BufferedMutatorParams(tableName)
.listener(listener)
.pool(pool);
if (options.getPeriodicFlushTimeout() > 0) {
mutatorParms = mutatorParms.setWriteBufferPeriodicFlushTimeoutMs(options.getPeriodicFlushTimeout());
}
try (
BufferedMutatorImpl mutator = (BufferedMutatorImpl) connection.getBufferedMutator(mutatorParms);
) {
Iterable<Row> documents = () -> rows;
for (Row doc : documents) {
String rowKey = doc.getString(0);
Put put = new Put(Bytes.toBytes(rowKey));
String value = doc.getString(2);
put.addColumn(Bytes.toBytes("valeur"), Bytes.toBytes(doc.getInt(1)), Bytes.toBytes(value == null ? "" : value));
value = doc.getString(3);
put.addColumn(Bytes.toBytes("valeur"), Bytes.toBytes("filler"), Bytes.toBytes(value == null ? "" : value));
mutator.mutate(put);
}
// If streaming: Final flush to make sure every thing is stored at the end of a microbatch //in batch, the close() will flush()
mutator.flush();
} catch (Exception e) {
log.info("Got exception ", e);
}
});

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec34Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall216branch-2.1 passed
+1compile23branch-2.1 passed
+1checkstyle29branch-2.1 passed
+1shadedjars219branch has no errors when building our shaded downstream artifacts.
+1findbugs56branch-2.1 passed
+1javadoc19branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall216the patch passed
+1compile24the patch passed
+1javac24the patch passed
+1checkstyle28hbase-client: The patch generated 0 new + 58 unchanged - 4 fixed = 58 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars224patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck898Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1findbugs65the patch passed
+1javadoc20the patch passed
_ Other Tests _
-1unit260hbase-client in the patch failed.
+1asflicense10The patch does not generate ASF License warnings.
2626
ReasonTests
Failed junit testshadoop.hbase.client.TestAsyncProcess
SubsystemReport/Notes
DockerClient=18.09.7 Server=18.09.7 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/17/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 3d45055c93ba 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / 3c017c5
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/17/artifact/out/patch-unit-hbase-client.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/17/testReport/
Max. process+thread count301 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/17/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec210Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall350branch-2.1 passed
+1compile30branch-2.1 passed
+1checkstyle44branch-2.1 passed
+1shadedjars307branch has no errors when building our shaded downstream artifacts.
+1findbugs81branch-2.1 passed
+1javadoc27branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall310the patch passed
+1compile31the patch passed
+1javac31the patch passed
+1checkstyle41hbase-client: The patch generated 0 new + 58 unchanged - 4 fixed = 58 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars303patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1234Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1findbugs91the patch passed
+1javadoc27the patch passed
_ Other Tests _
-1unit311hbase-client in the patch failed.
+1asflicense14The patch does not generate ASF License warnings.
3790
ReasonTests
Failed junit testshadoop.hbase.client.TestAsyncProcess
SubsystemReport/Notes
DockerClient=18.09.7 Server=18.09.7 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/18/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 6b9d71257330 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / 88ab7ac
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/18/artifact/out/patch-unit-hbase-client.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/18/testReport/
Max. process+thread count303 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/18/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec53Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall298branch-2.1 passed
+1compile24branch-2.1 passed
+1checkstyle32branch-2.1 passed
+1shadedjars236branch has no errors when building our shaded downstream artifacts.
+1findbugs59branch-2.1 passed
+1javadoc21branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall234the patch passed
+1compile23the patch passed
+1javac23the patch passed
+1checkstyle30hbase-client: The patch generated 0 new + 58 unchanged - 4 fixed = 58 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars232patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck931Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1findbugs65the patch passed
+1javadoc21the patch passed
_ Other Tests _
-1unit234hbase-client in the patch failed.
+1asflicense9The patch does not generate ASF License warnings.
2810
ReasonTests
Failed junit testshadoop.hbase.client.TestAsyncProcess
SubsystemReport/Notes
DockerClient=18.09.7 Server=18.09.7 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/19/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 45f6f0afd18a 4.4.0-137-generic #163-Ubuntu SMP Mon Sep 24 13:14:43 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2.1 / f017e7b
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/19/artifact/out/patch-unit-hbase-client.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/19/testReport/
Max. process+thread count301 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/19/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec101Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall376branch-2.1 passed
+1compile27branch-2.1 passed
+1checkstyle41branch-2.1 passed
+1shadedjars276branch has no errors when building our shaded downstream artifacts.
+1javadoc29branch-2.1 passed
0spotbugs92Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs90branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall368the patch passed
+1compile27the patch passed
+1javac27the patch passed
+1checkstyle43hbase-client: The patch generated 0 new + 58 unchanged - 4 fixed = 58 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars274patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1300Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc23the patch passed
+1findbugs79the patch passed
_ Other Tests _
+1unit203hbase-client in the patch passed.
+1asflicense12The patch does not generate ASF License warnings.
3657
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/46/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 5d943c830d25 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / 46d0e5a
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/46/testReport/
Max. process+thread count261 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/46/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

disableWriteBufferPeriodicFlush();
ap.waitAllSlot();
try {
// Let time to the periodic flush thread to exit (task are finished, but not the code after)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What is the problem if the code after is not finished? I'm a bit nervous that we just set a magic 5ms sleep time here...

private final boolean cleanupPoolOnClose;
private volatile boolean closed = false;
private final AsyncProcess ap;
private List<AsyncRequestFuture> asfList;

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this field need to be a class member? It seems that we only use it in the doFlush method.

if (flushAll || writeBufferSize == 0) {
// if we have setWriteBufferPeriodicFlushTimeoutMs we may have concurrent update
List<AsyncRequestFuture> waitList;
synchronized(asfList) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, I see, BufferedMutator is thread safe, so multiple threads can enter this method at the same time and we want them to share the safe asfList, so it should be class member.

}
if (nbRemoved == 0) {
try {
Thread.sleep(1);

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So this means we will do a busy waiting here? This is not always the best choice, maybe we should provide a configurable way to wait here, the default one should be the typical wait/notify, and if do not care wasting the CPU cycles but only want the maximum throughput, you can use busy waiting.

} else {
// Do some cleanup in asfList to decrease memory
int nbRemoved = 0;
while (asfList.size() >= maxThreads*4) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here we get size out of synchornized?

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec79Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall332branch-2.1 passed
+1compile24branch-2.1 passed
+1checkstyle38branch-2.1 passed
+1shadedjars256branch has no errors when building our shaded downstream artifacts.
+1javadoc24branch-2.1 passed
0spotbugs76Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs73branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall307the patch passed
+1compile25the patch passed
+1javac25the patch passed
+1checkstyle38hbase-client: The patch generated 0 new + 58 unchanged - 4 fixed = 58 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars254patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1300Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc23the patch passed
+1findbugs94the patch passed
_ Other Tests _
+1unit201hbase-client in the patch passed.
+1asflicense11The patch does not generate ASF License warnings.
3475
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/47/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 7beb14a1e07e 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / 78c4e49
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/47/testReport/
Max. process+thread count270 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/47/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec81Docker mode activated.
_ Prechecks _
+1dupname1No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall354branch-2.1 passed
+1compile25branch-2.1 passed
+1checkstyle39branch-2.1 passed
+1shadedjars257branch has no errors when building our shaded downstream artifacts.
+1javadoc25branch-2.1 passed
0spotbugs74Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs73branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall306the patch passed
+1compile25the patch passed
+1javac25the patch passed
+1checkstyle37hbase-client: The patch generated 0 new + 58 unchanged - 4 fixed = 58 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars252patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1286Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc22the patch passed
+1findbugs79the patch passed
_ Other Tests _
+1unit194hbase-client in the patch passed.
+1asflicense12The patch does not generate ASF License warnings.
3452
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/48/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 3237fbf51b3a 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343@2/out/precommit/personality/provided.sh
git revisionbranch-2.1 / 0d50ce1
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/48/testReport/
Max. process+thread count259 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/48/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec45Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall307branch-2.1 passed
+1compile24branch-2.1 passed
+1checkstyle38branch-2.1 passed
+1shadedjars235branch has no errors when building our shaded downstream artifacts.
+1javadoc25branch-2.1 passed
0spotbugs72Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs70branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall278the patch passed
+1compile24the patch passed
+1javac24the patch passed
+1checkstyle34hbase-client: The patch generated 0 new + 58 unchanged - 4 fixed = 58 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars228patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1151Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc21the patch passed
+1findbugs77the patch passed
_ Other Tests _
+1unit200hbase-client in the patch passed.
+1asflicense11The patch does not generate ASF License warnings.
3109
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/49/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 3d070eb302dc 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / d4d58f3
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/49/testReport/
Max. process+thread count300 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/49/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec118Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall371branch-2.1 passed
+1compile24branch-2.1 passed
+1checkstyle39branch-2.1 passed
+1shadedjars276branch has no errors when building our shaded downstream artifacts.
+1javadoc26branch-2.1 passed
0spotbugs79Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs77branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall320the patch passed
+1compile26the patch passed
+1javac26the patch passed
+1checkstyle39hbase-client: The patch generated 0 new + 58 unchanged - 4 fixed = 58 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars264patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1388Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc26the patch passed
+1findbugs85the patch passed
_ Other Tests _
+1unit206hbase-client in the patch passed.
+1asflicense11The patch does not generate ASF License warnings.
3715
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/50/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux ad1443169a5a 4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / 5cec62f
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/50/testReport/
Max. process+thread count257 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/50/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec161Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall356branch-2.1 passed
+1compile26branch-2.1 passed
+1checkstyle43branch-2.1 passed
+1shadedjars272branch has no errors when building our shaded downstream artifacts.
+1javadoc26branch-2.1 passed
0spotbugs76Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs74branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall334the patch passed
+1compile65the patch passed
+1javac65the patch passed
+1checkstyle85hbase-client: The patch generated 0 new + 58 unchanged - 4 fixed = 58 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars286patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1434Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc23the patch passed
+1findbugs81the patch passed
_ Other Tests _
+1unit201hbase-client in the patch passed.
+1asflicense12The patch does not generate ASF License warnings.
3889
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/51/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 37c39a7d70ca 4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / a5d981c
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/51/testReport/
Max. process+thread count261 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/51/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec137Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall477branch-2.1 passed
+1compile34branch-2.1 passed
+1checkstyle47branch-2.1 passed
+1shadedjars328branch has no errors when building our shaded downstream artifacts.
+1javadoc30branch-2.1 passed
0spotbugs96Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs94branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall445the patch passed
+1compile38the patch passed
+1javac38the patch passed
+1checkstyle47hbase-client: The patch generated 0 new + 58 unchanged - 4 fixed = 58 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars315patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1765Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc29the patch passed
+1findbugs101the patch passed
_ Other Tests _
+1unit220hbase-client in the patch passed.
+1asflicense14The patch does not generate ASF License warnings.
4644
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/52/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 42062b262c86 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / ea08907
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/52/testReport/
Max. process+thread count268 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/52/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec87Docker mode activated.
_ Prechecks _
+1dupname1No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall330branch-2.1 passed
+1compile26branch-2.1 passed
+1checkstyle40branch-2.1 passed
+1shadedjars272branch has no errors when building our shaded downstream artifacts.
+1javadoc27branch-2.1 passed
0spotbugs84Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs80branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall334the patch passed
+1compile27the patch passed
+1javac27the patch passed
+1checkstyle40hbase-client: The patch generated 0 new + 58 unchanged - 4 fixed = 58 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars275patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1406Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc23the patch passed
+1findbugs88the patch passed
_ Other Tests _
+1unit207hbase-client in the patch passed.
+1asflicense12The patch does not generate ASF License warnings.
3668
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/53/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux c8862fa4ca00 4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / 2a707ad
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/53/testReport/
Max. process+thread count275 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/53/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec157Docker mode activated.
_ Prechecks _
+1dupname1No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall411branch-2.1 passed
+1compile28branch-2.1 passed
+1checkstyle42branch-2.1 passed
+1shadedjars297branch has no errors when building our shaded downstream artifacts.
+1javadoc26branch-2.1 passed
0spotbugs91Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs87branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall354the patch passed
+1compile29the patch passed
+1javac29the patch passed
+1checkstyle43hbase-client: The patch generated 0 new + 58 unchanged - 4 fixed = 58 total (was 62)
+1whitespace0The patch has no whitespace issues.
+1shadedjars304patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1471Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc26the patch passed
+1findbugs92the patch passed
_ Other Tests _
+1unit222hbase-client in the patch passed.
+1asflicense13The patch does not generate ASF License warnings.
4042
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/54/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux ed60dd2fb467 4.4.0-143-generic #169-Ubuntu SMP Thu Feb 7 07:56:38 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / aaa9d93
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/54/testReport/
Max. process+thread count289 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/54/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec74Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall333branch-2.1 passed
+1compile24branch-2.1 passed
+1checkstyle40branch-2.1 passed
+1shadedjars264branch has no errors when building our shaded downstream artifacts.
+1javadoc30branch-2.1 passed
0spotbugs89Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs87branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall365the patch passed
+1compile26the patch passed
+1javac26the patch passed
+1checkstyle37hbase-client: The patch generated 0 new + 56 unchanged - 4 fixed = 56 total (was 60)
+1whitespace0The patch has no whitespace issues.
+1shadedjars261patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1343Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc24the patch passed
+1findbugs83the patch passed
_ Other Tests _
+1unit199hbase-client in the patch passed.
+1asflicense12The patch does not generate ASF License warnings.
3637
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/55/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 3eee6571095d 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / c9d02f9
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/55/testReport/
Max. process+thread count267 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/55/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec85Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall368branch-2.1 passed
+1compile27branch-2.1 passed
+1checkstyle41branch-2.1 passed
+1shadedjars266branch has no errors when building our shaded downstream artifacts.
+1javadoc26branch-2.1 passed
0spotbugs82Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs79branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall309the patch passed
+1compile28the patch passed
+1javac28the patch passed
+1checkstyle40hbase-client: The patch generated 0 new + 56 unchanged - 4 fixed = 56 total (was 60)
+1whitespace0The patch has no whitespace issues.
+1shadedjars294patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1359Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc23the patch passed
+1findbugs89the patch passed
_ Other Tests _
-1unit210hbase-client in the patch failed.
+1asflicense15The patch does not generate ASF License warnings.
3650
ReasonTests
Failed junit testshadoop.hbase.client.TestAsyncProcess
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/56/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux a619cf8d4c1c 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / a0d5627
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/56/artifact/out/patch-unit-hbase-client.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/56/testReport/
Max. process+thread count262 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/56/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec78Docker mode activated.
_ Prechecks _
+1dupname1No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall330branch-2.1 passed
+1compile27branch-2.1 passed
+1checkstyle45branch-2.1 passed
+1shadedjars270branch has no errors when building our shaded downstream artifacts.
+1javadoc25branch-2.1 passed
0spotbugs80Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs78branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall324the patch passed
+1compile30the patch passed
+1javac30the patch passed
+1checkstyle41hbase-client: The patch generated 0 new + 56 unchanged - 4 fixed = 56 total (was 60)
+1whitespace0The patch has no whitespace issues.
+1shadedjars273patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1338Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc22the patch passed
+1findbugs82the patch passed
_ Other Tests _
+1unit203hbase-client in the patch passed.
+1asflicense13The patch does not generate ASF License warnings.
3567
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/57/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux d98bc922f646 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / bfe09e9
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/57/testReport/
Max. process+thread count268 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/57/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec115Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall430branch-2.1 passed
+1compile33branch-2.1 passed
+1checkstyle45branch-2.1 passed
+1shadedjars304branch has no errors when building our shaded downstream artifacts.
+1javadoc28branch-2.1 passed
0spotbugs101Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs98branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall400the patch passed
+1compile36the patch passed
+1javac36the patch passed
+1checkstyle53hbase-client: The patch generated 0 new + 56 unchanged - 4 fixed = 56 total (was 60)
+1whitespace0The patch has no whitespace issues.
+1shadedjars300patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1302Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc23the patch passed
+1findbugs78the patch passed
_ Other Tests _
+1unit197hbase-client in the patch passed.
+1asflicense12The patch does not generate ASF License warnings.
3861
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/58/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 09072897a11c 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / 9ee32d8
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/58/testReport/
Max. process+thread count270 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/58/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec111Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall345branch-2.1 passed
+1compile27branch-2.1 passed
+1checkstyle40branch-2.1 passed
+1shadedjars269branch has no errors when building our shaded downstream artifacts.
+1javadoc26branch-2.1 passed
0spotbugs78Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs77branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall334the patch passed
+1compile30the patch passed
+1javac30the patch passed
+1checkstyle39hbase-client: The patch generated 0 new + 56 unchanged - 4 fixed = 56 total (was 60)
+1whitespace0The patch has no whitespace issues.
+1shadedjars267patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1337Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc24the patch passed
+1findbugs90the patch passed
_ Other Tests _
+1unit199hbase-client in the patch passed.
+1asflicense13The patch does not generate ASF License warnings.
3623
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/59/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 32abfb00c23e 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / 69946d1
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/59/testReport/
Max. process+thread count252 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/59/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec38Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall364branch-2.1 passed
+1compile23branch-2.1 passed
+1checkstyle34branch-2.1 passed
+1shadedjars235branch has no errors when building our shaded downstream artifacts.
+1javadoc22branch-2.1 passed
0spotbugs70Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs68branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall264the patch passed
+1compile24the patch passed
+1javac24the patch passed
+1checkstyle30hbase-client: The patch generated 0 new + 56 unchanged - 4 fixed = 56 total (was 60)
+1whitespace0The patch has no whitespace issues.
+1shadedjars232patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1244Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc21the patch passed
+1findbugs79the patch passed
_ Other Tests _
+1unit200hbase-client in the patch passed.
+1asflicense12The patch does not generate ASF License warnings.
3244
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/60/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux e1243f99370a 4.4.0-139-generic #165-Ubuntu SMP Wed Oct 24 10:58:50 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / 6444158
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/60/testReport/
Max. process+thread count295 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/60/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec38Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall311branch-2.1 passed
+1compile26branch-2.1 passed
+1checkstyle35branch-2.1 passed
+1shadedjars234branch has no errors when building our shaded downstream artifacts.
+1javadoc25branch-2.1 passed
0spotbugs73Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs72branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall290the patch passed
+1compile25the patch passed
+1javac25the patch passed
+1checkstyle37hbase-client: The patch generated 0 new + 56 unchanged - 4 fixed = 56 total (was 60)
+1whitespace0The patch has no whitespace issues.
+1shadedjars241patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1160Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc23the patch passed
+1findbugs78the patch passed
_ Other Tests _
+1unit202hbase-client in the patch passed.
+1asflicense11The patch does not generate ASF License warnings.
3165
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/61/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 20cd70060397 4.4.0-139-generic #165-Ubuntu SMP Wed Oct 24 10:58:50 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / e27ef92
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/61/testReport/
Max. process+thread count292 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/61/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec136Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall474branch-2.1 passed
+1compile29branch-2.1 passed
+1checkstyle47branch-2.1 passed
+1shadedjars319branch has no errors when building our shaded downstream artifacts.
+1javadoc28branch-2.1 passed
0spotbugs99Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs94branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall366the patch passed
+1compile50the patch passed
+1javac50the patch passed
+1checkstyle54hbase-client: The patch generated 0 new + 56 unchanged - 4 fixed = 56 total (was 60)
+1whitespace0The patch has no whitespace issues.
+1shadedjars282patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1627Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc28the patch passed
+1findbugs100the patch passed
_ Other Tests _
+1unit223hbase-client in the patch passed.
+1asflicense15The patch does not generate ASF License warnings.
4294
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/62/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux aca5f00e913f 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / fb7e7d8
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/62/testReport/
Max. process+thread count298 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/62/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec172Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ branch-2.1 Compile Tests _
+1mvninstall415branch-2.1 passed
+1compile59branch-2.1 passed
+1checkstyle40branch-2.1 passed
+1shadedjars274branch has no errors when building our shaded downstream artifacts.
+1javadoc52branch-2.1 passed
0spotbugs92Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs83branch-2.1 passed
_ Patch Compile Tests _
+1mvninstall337the patch passed
+1compile25the patch passed
+1javac25the patch passed
+1checkstyle42hbase-client: The patch generated 0 new + 56 unchanged - 4 fixed = 56 total (was 60)
+1whitespace0The patch has no whitespace issues.
+1shadedjars265patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1343Patch does not cause any errors with Hadoop 2.7.7 2.8.5 or 3.0.3 3.1.2.
+1javadoc27the patch passed
+1findbugs83the patch passed
_ Other Tests _
+1unit206hbase-client in the patch passed.
+1asflicense15The patch does not generate ASF License warnings.
3846
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/63/artifact/out/Dockerfile
GITHUB PR#343
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux ee62889b94ba 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-343/out/precommit/personality/provided.sh
git revisionbranch-2.1 / 0c906f0
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/63/testReport/
Max. process+thread count291 (vs. ulimit of 10000)
modulesC: hbase-client U: hbase-client
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-343/63/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache9

Copy link
Copy Markdown
Contributor

Close since no big progress here. Can open a new PR which targets to branch-2 if you have time @sbarnoud . Or I will try to port the patch if I have time.

@Apache9Apache9 closed this Aug 14, 2019
@sbarnoud

sbarnoud commented Aug 14, 2019 via email

Copy link
Copy Markdown
Author

@Apache9

Copy link
Copy Markdown
Contributor

Performance is not everything. To be honest, the patch is still not qualified enough to be merged. Please see my last comments, doing busy wait( sleep(1) ) on a critical path is usually a no no, especially that you are waiting for external I/O to complete rather than an in memory operation...

Anyway, I got your point that the current implementation of BufferMutator could be optimized to increase the concurrency. Will take a look if I have time.

Thanks.

@sbarnoud

sbarnoud commented Aug 14, 2019 via email

Copy link
Copy Markdown
Author

@Apache9

Copy link
Copy Markdown
Contributor

Not sure why you keep saying 'benchmark' since I never challenge the performance improvement of your patch?

@sbarnoud

sbarnoud commented Aug 14, 2019 via email

Copy link
Copy Markdown
Author

@Apache9

Copy link
Copy Markdown
Contributor

Please read my comment carefully

So this means we will do a busy waiting here? This is not always the best choice, maybe we should provide a configurable way to wait here, the default one should be the typical wait/notify, and if do not care wasting the CPU cycles but only want the maximum throughput, you can use busy waiting.

I'm not telling that sleep will have a worse performance right? Just make it configurable. Maximum throughput is not always the best choice. User may have a mixed workload and do not want to waste too many CPU cycles here.

In that case, it may be better to give some time to the server to dequeue queries instead of submitting as soon as possible new one.

I can not get the point here, we must wait until the server dequeue queries right? Otherwise we do not need to introduce the complicated slot logic...
The difference here is whether to use a 'while sleep' or a 'wait/notify'. My suggestion is to provide both.

Thanks.

@sbarnoud

Copy link
Copy Markdown
Author

No 'while/sleep' nor 'wait/notify' needed anymore.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@sbarnoud@busbey@Apache-HBase@Apache9