Skip to content

HBASE-27904: Adding a data generator command line utility leveraging HBase bulk load - #5279

Open
Himanshu-g81 wants to merge 3 commits into
apache:branch-2.4from
Himanshu-g81:datagenerator-tool
Open

HBASE-27904: Adding a data generator command line utility leveraging HBase bulk load#5279
Himanshu-g81 wants to merge 3 commits into
apache:branch-2.4from
Himanshu-g81:datagenerator-tool

Conversation

@Himanshu-g81

@Himanshu-g81Himanshu-g81 commented Jun 8, 2023

Copy link
Copy Markdown
Contributor

Details in JIRA: HBASE-27904

branch-2.4 backport of #5280

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 11sDocker mode activated.
-0 ⚠️yetus0m 6sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ branch-2.4 Compile Tests _
+1 💚mvninstall2m 42sbranch-2.4 passed
+1 💚compile0m 20sbranch-2.4 passed
+1 💚shadedjars4m 25sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 12sbranch-2.4 passed
_ Patch Compile Tests _
+1 💚mvninstall2m 0sthe patch passed
+1 💚compile0m 17sthe patch passed
+1 💚javac0m 17sthe patch passed
+1 💚shadedjars4m 20spatch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 14sthe patch passed
_ Other Tests _
-1 ❌unit21m 10shbase-mapreduce in the patch failed.
38m 4s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5279/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR#5279
JIRA IssueHBASE-27904
Optional Testsjavac javadoc unit shadedjars compile
unameLinux dc79f87442c9 5.4.0-1101-aws #109~18.04.1-Ubuntu SMP Mon Apr 24 20:40:49 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2.4 / 7d78979
Default JavaTemurin-1.8.0_352-b08
unithttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5279/1/artifact/yetus-jdk8-hadoop2-check/output/patch-unit-hbase-mapreduce.txt
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5279/1/testReport/
Max. process+thread count2565 (vs. ulimit of 30000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5279/1/console
versionsgit=2.34.1 maven=3.8.6
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 39sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
_ branch-2.4 Compile Tests _
+1 💚mvninstall3m 57sbranch-2.4 passed
+1 💚compile0m 55sbranch-2.4 passed
+1 💚checkstyle0m 22sbranch-2.4 passed
+1 💚spotless0m 59sbranch has no errors when running spotless:check.
+1 💚spotbugs0m 38sbranch-2.4 passed
_ Patch Compile Tests _
+1 💚mvninstall3m 28sthe patch passed
+1 💚compile0m 56sthe patch passed
-0 ⚠️javac0m 56shbase-mapreduce generated 16 new + 183 unchanged - 16 fixed = 199 total (was 199)
-0 ⚠️checkstyle0m 15shbase-mapreduce: The patch generated 5 new + 0 unchanged - 0 fixed = 5 total (was 0)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚xml0m 2sThe patch has no ill-formed XML file.
+1 💚hadoopcheck24m 48sPatch does not cause any errors with Hadoop 2.10.2 or 3.1.4 3.2.4 3.3.5.
+1 💚spotless1m 2spatch has no errors when running spotless:check.
+1 💚spotbugs0m 58sthe patch passed
_ Other Tests _
+1 💚asflicense0m 14sThe patch does not generate ASF License warnings.
41m 49s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5279/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#5279
JIRA IssueHBASE-27904
Optional Testsdupname asflicense javac hadoopcheck spotless xml compile spotbugs hbaseanti checkstyle
unameLinux eff2b75bf107 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2.4 / 7d78979
Default JavaEclipse Adoptium-11.0.17+8
javachttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5279/1/artifact/yetus-general-check/output/diff-compile-javac-hbase-mapreduce.txt
checkstylehttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5279/1/artifact/yetus-general-check/output/diff-checkstyle-hbase-mapreduce.txt
Max. process+thread count79 (vs. ulimit of 30000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5279/1/console
versionsgit=2.34.1 maven=3.8.6 spotbugs=4.7.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 9sDocker mode activated.
-0 ⚠️yetus0m 6sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ branch-2.4 Compile Tests _
+1 💚mvninstall4m 19sbranch-2.4 passed
+1 💚compile0m 26sbranch-2.4 passed
+1 💚shadedjars6m 45sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 19sbranch-2.4 passed
_ Patch Compile Tests _
+1 💚mvninstall3m 27sthe patch passed
+1 💚compile0m 23sthe patch passed
+1 💚javac0m 23sthe patch passed
+1 💚shadedjars6m 13spatch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 21sthe patch passed
_ Other Tests _
-1 ❌unit22m 49shbase-mapreduce in the patch failed.
47m 29s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5279/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR#5279
JIRA IssueHBASE-27904
Optional Testsjavac javadoc unit shadedjars compile
unameLinux a4ae478b737d 5.4.0-1101-aws #109~18.04.1-Ubuntu SMP Mon Apr 24 20:40:49 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2.4 / 7d78979
Default JavaEclipse Adoptium-11.0.17+8
unithttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5279/1/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-mapreduce.txt
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5279/1/testReport/
Max. process+thread count2999 (vs. ulimit of 30000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5279/1/console
versionsgit=2.34.1 maven=3.8.6
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@virajjasani
virajjasani self-requested a review June 8, 2023 20:05
@virajjasanivirajjasani added the backport This PR is a back port of some issue or issues already committed to master label Jun 8, 2023
@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 30sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
_ branch-2.4 Compile Tests _
+1 💚mvninstall3m 29sbranch-2.4 passed
+1 💚compile0m 40sbranch-2.4 passed
+1 💚checkstyle0m 15sbranch-2.4 passed
+1 💚spotless0m 57sbranch has no errors when running spotless:check.
+1 💚spotbugs0m 43sbranch-2.4 passed
_ Patch Compile Tests _
+1 💚mvninstall2m 46sthe patch passed
+1 💚compile0m 37sthe patch passed
-0 ⚠️javac0m 37shbase-mapreduce generated 13 new + 186 unchanged - 13 fixed = 199 total (was 199)
-0 ⚠️checkstyle0m 12shbase-mapreduce: The patch generated 5 new + 0 unchanged - 0 fixed = 5 total (was 0)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚xml0m 1sThe patch has no ill-formed XML file.
+1 💚hadoopcheck21m 38sPatch does not cause any errors with Hadoop 2.10.2 or 3.1.4 3.2.4 3.3.5.
+1 💚spotless1m 9spatch has no errors when running spotless:check.
+1 💚spotbugs1m 4sthe patch passed
_ Other Tests _
+1 💚asflicense0m 17sThe patch does not generate ASF License warnings.
36m 54s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/hbase-kustomize-github-pr/job/PR-5279/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#5279
Optional Testsdupname asflicense javac hadoopcheck spotless xml compile spotbugs hbaseanti checkstyle
unameLinux 41026b5e0393 5.4.0-144-generic #161-Ubuntu SMP Fri Feb 3 14:49:04 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2.4 / 13a063e
Default JavaEclipse Adoptium-11.0.17+8
javachttps://ci-hbase.apache.org/job/hbase-kustomize-github-pr/job/PR-5279/1/artifact/yetus-general-check/output/diff-compile-javac-hbase-mapreduce.txt
checkstylehttps://ci-hbase.apache.org/job/hbase-kustomize-github-pr/job/PR-5279/1/artifact/yetus-general-check/output/diff-checkstyle-hbase-mapreduce.txt
Max. process+thread count79 (vs. ulimit of 30000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://ci-hbase.apache.org/job/hbase-kustomize-github-pr/job/PR-5279/1/console
versionsgit=2.34.1 maven=3.8.6 spotbugs=4.7.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 37sDocker mode activated.
-0 ⚠️yetus0m 6sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ branch-2.4 Compile Tests _
+1 💚mvninstall2m 55sbranch-2.4 passed
+1 💚compile0m 26sbranch-2.4 passed
+1 💚shadedjars5m 22sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 17sbranch-2.4 passed
_ Patch Compile Tests _
+1 💚mvninstall2m 39sthe patch passed
+1 💚compile0m 20sthe patch passed
+1 💚javac0m 20sthe patch passed
+1 💚shadedjars5m 34spatch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 18sthe patch passed
_ Other Tests _
-1 ❌unit22m 46shbase-mapreduce in the patch failed.
42m 16s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/hbase-kustomize-github-pr/job/PR-5279/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR#5279
Optional Testsjavac javadoc unit shadedjars compile
unameLinux e0141c310205 5.4.0-148-generic #165-Ubuntu SMP Tue Apr 18 08:53:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2.4 / 13a063e
Default JavaEclipse Adoptium-11.0.17+8
unithttps://ci-hbase.apache.org/job/hbase-kustomize-github-pr/job/PR-5279/1/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-mapreduce.txt
Test Resultshttps://ci-hbase.apache.org/job/hbase-kustomize-github-pr/job/PR-5279/1/testReport/
Max. process+thread count3054 (vs. ulimit of 30000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://ci-hbase.apache.org/job/hbase-kustomize-github-pr/job/PR-5279/1/console
versionsgit=2.34.1 maven=3.8.6
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 1sDocker mode activated.
-0 ⚠️yetus0m 4sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ branch-2.4 Compile Tests _
+1 💚mvninstall3m 6sbranch-2.4 passed
+1 💚compile0m 22sbranch-2.4 passed
+1 💚shadedjars4m 49sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 15sbranch-2.4 passed
_ Patch Compile Tests _
+1 💚mvninstall2m 13sthe patch passed
+1 💚compile0m 18sthe patch passed
+1 💚javac0m 18sthe patch passed
+1 💚shadedjars5m 9spatch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 12sthe patch passed
_ Other Tests _
-1 ❌unit24m 20shbase-mapreduce in the patch failed.
42m 51s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/hbase-kustomize-github-pr/job/PR-5279/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR#5279
Optional Testsjavac javadoc unit shadedjars compile
unameLinux f413df771a1a 5.4.0-1101-aws #109~18.04.1-Ubuntu SMP Mon Apr 24 20:40:49 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2.4 / 13a063e
Default JavaTemurin-1.8.0_352-b08
unithttps://ci-hbase.apache.org/job/hbase-kustomize-github-pr/job/PR-5279/1/artifact/yetus-jdk8-hadoop2-check/output/patch-unit-hbase-mapreduce.txt
Test Resultshttps://ci-hbase.apache.org/job/hbase-kustomize-github-pr/job/PR-5279/1/testReport/
Max. process+thread count2610 (vs. ulimit of 30000)
modulesC: hbase-mapreduce U: hbase-mapreduce
Console outputhttps://ci-hbase.apache.org/job/hbase-kustomize-github-pr/job/PR-5279/1/console
versionsgit=2.34.1 maven=3.8.6
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backportThis PR is a back port of some issue or issues already committed to master

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@Himanshu-g81@Apache-HBase@virajjasani