Skip to content

HBASE-22887 Fix HFileOutputFormat2 writer roll - #554

Merged
saintstack merged 2 commits into
apache:masterfrom
langdamao:HBASE-22887
Oct 8, 2019
Merged

HBASE-22887 Fix HFileOutputFormat2 writer roll#554
saintstack merged 2 commits into
apache:masterfrom
langdamao:HBASE-22887

Conversation

@langdamao

Copy link
Copy Markdown
Contributor

Issue detail: https://issues.apache.org/jira/browse/HBASE-22887

  • writer roll only if wl.written is too long and previousRow is not equal.

  • delete bool rollRequested because different writter roll independently, so they don't need to communicate.

Signed-off-by: langdamao lang--lang--lang@163.com

Signed-off-by: langdamao <lang--lang--lang@163.com>
@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec76Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall360master passed
+1compile27master passed
+1checkstyle21master passed
+1shadedjars300branch has no errors when building our shaded downstream artifacts.
+1javadoc18master passed
0spotbugs54Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs52master passed
_ Patch Compile Tests _
+1mvninstall336the patch passed
+1compile27the patch passed
+1javac27the patch passed
+1checkstyle21the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars308patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1036Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc17the patch passed
+1findbugs60the patch passed
_ Other Tests _
+1unit1392hbase-mapreduce in the patch passed.
+1asflicense17The patch does not generate ASF License warnings.
4493
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/1/artifact/out/Dockerfile
GITHUB PR#554
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 6678b9bd62b5 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-554/out/precommit/personality/provided.sh
git revisionmaster / 56980fb
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/1/testReport/
Max. process+thread count5036 (vs. ulimit of 10000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/1/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec47Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall331master passed
+1compile27master passed
+1checkstyle23master passed
+1shadedjars273branch has no errors when building our shaded downstream artifacts.
+1javadoc20master passed
0spotbugs53Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs50master passed
_ Patch Compile Tests _
+1mvninstall295the patch passed
+1compile27the patch passed
+1javac27the patch passed
+1checkstyle20the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars275patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck914Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc18the patch passed
+1findbugs55the patch passed
_ Other Tests _
-1unit1094hbase-mapreduce in the patch failed.
+1asflicense15The patch does not generate ASF License warnings.
3850
ReasonTests
Failed junit testshadoop.hbase.snapshot.TestExportSnapshotNoCluster
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/2/artifact/out/Dockerfile
GITHUB PR#554
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 69ee9677daf8 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-554/out/precommit/personality/provided.sh
git revisionmaster / 83e7794
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/2/artifact/out/patch-unit-hbase-mapreduce.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/2/testReport/
Max. process+thread count5384 (vs. ulimit of 10000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/2/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec38Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall446master passed
+1compile29master passed
+1checkstyle21master passed
+1shadedjars300branch has no errors when building our shaded downstream artifacts.
+1javadoc18master passed
0spotbugs51Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs48master passed
_ Patch Compile Tests _
+1mvninstall331the patch passed
+1compile26the patch passed
+1javac26the patch passed
+1checkstyle19the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars302patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1044Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc16the patch passed
+1findbugs61the patch passed
_ Other Tests _
-1unit1115hbase-mapreduce in the patch failed.
+1asflicense15The patch does not generate ASF License warnings.
4240
ReasonTests
Failed junit testshadoop.hbase.snapshot.TestExportSnapshot
hadoop.hbase.snapshot.TestExportSnapshotNoCluster
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/3/artifact/out/Dockerfile
GITHUB PR#554
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 1aff48fd2c04 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-554/out/precommit/personality/provided.sh
git revisionmaster / f6a4c66
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/3/artifact/out/patch-unit-hbase-mapreduce.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/3/testReport/
Max. process+thread count5253 (vs. ulimit of 10000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/3/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec38Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall376master passed
+1compile30master passed
+1checkstyle23master passed
+1shadedjars289branch has no errors when building our shaded downstream artifacts.
+1javadoc20master passed
0spotbugs55Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs52master passed
_ Patch Compile Tests _
+1mvninstall308the patch passed
+1compile30the patch passed
+1javac30the patch passed
+1checkstyle22the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars285patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck957Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc18the patch passed
+1findbugs58the patch passed
_ Other Tests _
-1unit1083hbase-mapreduce in the patch failed.
+1asflicense20The patch does not generate ASF License warnings.
3997
ReasonTests
Failed junit testshadoop.hbase.snapshot.TestExportSnapshotNoCluster
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/4/artifact/out/Dockerfile
GITHUB PR#554
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 57e954d8bc83 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-554/out/precommit/personality/provided.sh
git revisionmaster / 090c55f
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/4/artifact/out/patch-unit-hbase-mapreduce.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/4/testReport/
Max. process+thread count5428 (vs. ulimit of 10000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/4/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec83Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall344master passed
+1compile28master passed
+1checkstyle26master passed
+1shadedjars305branch has no errors when building our shaded downstream artifacts.
+1javadoc18master passed
0spotbugs55Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs53master passed
_ Patch Compile Tests _
+1mvninstall321the patch passed
+1compile27the patch passed
+1javac27the patch passed
+1checkstyle19the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars290patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck977Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc17the patch passed
+1findbugs53the patch passed
_ Other Tests _
+1unit1336hbase-mapreduce in the patch passed.
+1asflicense16The patch does not generate ASF License warnings.
4301
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/5/artifact/out/Dockerfile
GITHUB PR#554
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux b4dda039e94b 4.15.0-48-generic #51-Ubuntu SMP Wed Apr 3 08:28:49 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-554/out/precommit/personality/provided.sh
git revisionmaster / ee5cf0d
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/5/testReport/
Max. process+thread count5313 (vs. ulimit of 10000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/5/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec38Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall347master passed
+1compile27master passed
+1checkstyle21master passed
+1shadedjars289branch has no errors when building our shaded downstream artifacts.
+1javadoc20master passed
0spotbugs57Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs54master passed
_ Patch Compile Tests _
+1mvninstall309the patch passed
+1compile28the patch passed
+1javac28the patch passed
+1checkstyle21the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars282patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck981Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc18the patch passed
+1findbugs55the patch passed
_ Other Tests _
+1unit1225hbase-mapreduce in the patch passed.
+1asflicense17The patch does not generate ASF License warnings.
4113
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/6/artifact/out/Dockerfile
GITHUB PR#554
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 0b7391ee575c 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-554/out/precommit/personality/provided.sh
git revisionmaster / b642ee0
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/6/testReport/
Max. process+thread count5475 (vs. ulimit of 10000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/6/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec121Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall486master passed
+1compile35master passed
+1checkstyle30master passed
+1shadedjars361branch has no errors when building our shaded downstream artifacts.
+1javadoc25master passed
0spotbugs68Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs65master passed
_ Patch Compile Tests _
+1mvninstall402the patch passed
+1compile32the patch passed
+1javac32the patch passed
+1checkstyle24the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars368patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1433Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc20the patch passed
+1findbugs76the patch passed
_ Other Tests _
-1unit1669hbase-mapreduce in the patch failed.
+1asflicense17The patch does not generate ASF License warnings.
5710
ReasonTests
Failed junit testshadoop.hbase.snapshot.TestExportSnapshotNoCluster
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/7/artifact/out/Dockerfile
GITHUB PR#554
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux befec5fd6679 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-554/out/precommit/personality/provided.sh
git revisionmaster / 97fbaa6
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/7/artifact/out/patch-unit-hbase-mapreduce.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/7/testReport/
Max. process+thread count5208 (vs. ulimit of 10000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/7/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec75Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall357master passed
+1compile27master passed
+1checkstyle23master passed
+1shadedjars307branch has no errors when building our shaded downstream artifacts.
+1javadoc19master passed
0spotbugs61Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs58master passed
_ Patch Compile Tests _
+1mvninstall334the patch passed
+1compile28the patch passed
+1javac28the patch passed
+1checkstyle20the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars302patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1047Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc17the patch passed
+1findbugs57the patch passed
_ Other Tests _
-1unit1438hbase-mapreduce in the patch failed.
+1asflicense18The patch does not generate ASF License warnings.
4538
ReasonTests
Failed junit testshadoop.hbase.snapshot.TestExportSnapshotNoCluster
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/8/artifact/out/Dockerfile
GITHUB PR#554
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 09ec40216e72 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-554/out/precommit/personality/provided.sh
git revisionmaster / 345c21d
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/8/artifact/out/patch-unit-hbase-mapreduce.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/8/testReport/
Max. process+thread count5411 (vs. ulimit of 10000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/8/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec34Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall323master passed
+1compile27master passed
+1checkstyle21master passed
+1shadedjars271branch has no errors when building our shaded downstream artifacts.
+1javadoc23master passed
0spotbugs49Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs48master passed
_ Patch Compile Tests _
+1mvninstall296the patch passed
+1compile27the patch passed
+1javac27the patch passed
+1checkstyle20the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars273patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck917Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc18the patch passed
+1findbugs51the patch passed
_ Other Tests _
-1unit1059hbase-mapreduce in the patch failed.
+1asflicense19The patch does not generate ASF License warnings.
3792
ReasonTests
Failed junit testshadoop.hbase.snapshot.TestExportSnapshotNoCluster
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/9/artifact/out/Dockerfile
GITHUB PR#554
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 36d1a6ba9823 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-554/out/precommit/personality/provided.sh
git revisionmaster / a5ef6b2
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/9/artifact/out/patch-unit-hbase-mapreduce.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/9/testReport/
Max. process+thread count5405 (vs. ulimit of 10000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/9/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec42Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall359master passed
+1compile29master passed
+1checkstyle24master passed
+1shadedjars293branch has no errors when building our shaded downstream artifacts.
+1javadoc20master passed
0spotbugs57Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs54master passed
_ Patch Compile Tests _
+1mvninstall314the patch passed
+1compile27the patch passed
+1javac27the patch passed
+1checkstyle21the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars291patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck989Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc19the patch passed
+1findbugs57the patch passed
_ Other Tests _
+1unit1135hbase-mapreduce in the patch passed.
+1asflicense19The patch does not generate ASF License warnings.
4077
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/10/artifact/out/Dockerfile
GITHUB PR#554
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 767348ce9935 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-554/out/precommit/personality/provided.sh
git revisionmaster / d32bf8d
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/10/testReport/
Max. process+thread count5487 (vs. ulimit of 10000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/10/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec90Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall361master passed
+1compile27master passed
+1checkstyle22master passed
+1shadedjars309branch has no errors when building our shaded downstream artifacts.
+1javadoc19master passed
0spotbugs55Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs52master passed
_ Patch Compile Tests _
+1mvninstall334the patch passed
+1compile27the patch passed
+1javac27the patch passed
+1checkstyle21the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars308patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1077Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc20the patch passed
+1findbugs63the patch passed
_ Other Tests _
+1unit1387hbase-mapreduce in the patch passed.
+1asflicense15The patch does not generate ASF License warnings.
4532
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/11/artifact/out/Dockerfile
GITHUB PR#554
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 368755c45303 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-554/out/precommit/personality/provided.sh
git revisionmaster / 8e8bd8b
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/11/testReport/
Max. process+thread count5066 (vs. ulimit of 10000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/11/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@saintstacksaintstack left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Any chance of a UT?

@saintstacksaintstack left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Patch LGTM. Can we have a unit test? Thanks.

@langdamao

Copy link
Copy Markdown
ContributorAuthor

Patch LGTM. Can we have a unit test? Thanks.

Sorry for miss the last message.
Yes, I think TestHFileOutputFormat2 fits this. Is this comprehensive enought for this patch?
I don't know how to make it more strong for this patch. Could you give me some suggestions, please?
Thank you so much :)

@infraio

Copy link
Copy Markdown
Contributor

@langdamao You can check TestHFileOutputFormat2#testWritingPEData to write a ut and test the generated files size is small than a value.

@langdamao

Copy link
Copy Markdown
ContributorAuthor

@langdamao You can check TestHFileOutputFormat2#testWritingPEData to write a ut and test the generated files size is small than a value.

Got it, thank you so much! I'll try!

Signed-off-by: langdamao <lang--lang--lang@163.com>
@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
💙reexec0m 34sDocker mode activated.
_ Prechecks _
💚dupname0m 0sNo case conflicting files found.
💚hbaseanti0m 0sPatch does not have any anti-patterns.
💚@author0m 0sThe patch does not contain any @author tags.
💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ master Compile Tests _
💚mvninstall6m 24smaster passed
💚compile0m 27smaster passed
💚checkstyle0m 22smaster passed
💚shadedjars4m 36sbranch has no errors when building our shaded downstream artifacts.
💚javadoc0m 20smaster passed
💙spotbugs0m 55sUsed deprecated FindBugs config; considering switching to SpotBugs.
💚findbugs0m 53smaster passed
_ Patch Compile Tests _
💚mvninstall4m 56sthe patch passed
💚compile0m 26sthe patch passed
💚javac0m 26sthe patch passed
💚checkstyle0m 22sthe patch passed
💚whitespace0m 0sThe patch has no whitespace issues.
💚shadedjars4m 35spatch has no errors when building our shaded downstream artifacts.
💚hadoopcheck15m 31sPatch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
💚javadoc0m 19sthe patch passed
💚findbugs0m 53sthe patch passed
_ Other Tests _
💚unit17m 19shbase-mapreduce in the patch passed.
💚asflicense0m 20sThe patch does not generate ASF License warnings.
64m 48s
SubsystemReport/Notes
DockerClient=19.03.2 Server=19.03.2 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/12/artifact/out/Dockerfile
GITHUB PR#554
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 901e909e4ce6 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-554/out/precommit/personality/provided.sh
git revisionmaster / e911bb7
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/12/testReport/
Max. process+thread count5646 (vs. ulimit of 10000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-554/12/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.11.0 https://yetus.apache.org

This message was automatically generated.

@saintstack
saintstack merged commit 128b480 into apache:masterOct 8, 2019
asfgit pushed a commit that referenced this pull request Oct 8, 2019
Signed-off-by: langdamao <lang--lang--lang@163.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@langdamao@Apache-HBase@infraio@saintstack