Skip to content

HBASE-28655 IllegalArgumentException: Illegal bufferSize thrown when hbase.io.compress.zstd.buffersize is not configured - #6121

Merged
pankaj72981 merged 1 commit into
apache:branch-2from
pankaj72981:HBASE-28655-branch-2
Jul 25, 2024
Merged

HBASE-28655 IllegalArgumentException: Illegal bufferSize thrown when hbase.io.compress.zstd.buffersize is not configured #6121
pankaj72981 merged 1 commit into
apache:branch-2from
pankaj72981:HBASE-28655-branch-2

Conversation

@pankaj72981

@pankaj72981pankaj72981 commented Jul 25, 2024

Copy link
Copy Markdown
Contributor

HADOOP-18810 added io.compression.codec.zstd.buffersize in core-default.xml with default value as 0, so default value of hbase.io.compress.zstd.buffersize will become 0 instead of ZSTD_BUFFER_SIZE_DEFAULT (256 * 1024) when not configured in hbase-site.xml.

(cherry picked from commit 73f2710)

@pankaj72981
HBASE-28655 IllegalArgumentException: Illegal bufferSize thrown when …
2ed3a81
…hbase.io.compress.zstd.buffersize is not configured (apache#6114)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Vineet Kumar Maheshwari <vineet.4008@gmail.com>
(cherry picked from commit 73f2710)
@pankaj72981pankaj72981 added the backport This PR is a back port of some issue or issues already committed to master label Jul 25, 2024
@Apache-HBase

Apache-HBase commented Jul 25, 2024

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 42sDocker mode activated.
-0 ⚠️yetus0m 6sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+0 🆗mvndep0m 10sMaven dependency ordering for branch
+1 💚mvninstall2m 34sbranch-2 passed
+1 💚compile0m 26sbranch-2 passed
+1 💚javadoc0m 22sbranch-2 passed
+1 💚shadedjars5m 21sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+0 🆗mvndep0m 13sMaven dependency ordering for patch
+1 💚mvninstall2m 23sthe patch passed
+1 💚compile0m 26sthe patch passed
+1 💚javac0m 26sthe patch passed
+1 💚javadoc0m 21sthe patch passed
+1 💚shadedjars5m 18spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
+1 💚unit0m 57shbase-compression-aircompressor in the patch passed.
+1 💚unit2m 28shbase-compression-zstd in the patch passed.
23m 1s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6121/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR#6121
Optional Testsjavac javadoc unit compile shadedjars
unameLinux 7b7c77780406 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 2ed3a81
Default JavaTemurin-1.8.0_412-b08
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6121/1/testReport/
Max. process+thread count761 (vs. ulimit of 30000)
modulesC: hbase-compression/hbase-compression-aircompressor hbase-compression/hbase-compression-zstd U: hbase-compression
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6121/1/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Apache-HBase commented Jul 25, 2024

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 48sDocker mode activated.
-0 ⚠️yetus0m 5sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+0 🆗mvndep0m 9sMaven dependency ordering for branch
+1 💚mvninstall3m 3sbranch-2 passed
+1 💚compile0m 35sbranch-2 passed
+1 💚javadoc0m 29sbranch-2 passed
+1 💚shadedjars5m 37sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+0 🆗mvndep0m 17sMaven dependency ordering for patch
+1 💚mvninstall3m 4sthe patch passed
+1 💚compile0m 35sthe patch passed
+1 💚javac0m 35sthe patch passed
+1 💚javadoc0m 28sthe patch passed
+1 💚shadedjars5m 34spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
+1 💚unit1m 0shbase-compression-aircompressor in the patch passed.
+1 💚unit2m 52shbase-compression-zstd in the patch passed.
25m 53s
SubsystemReport/Notes
DockerClientAPI=1.46 ServerAPI=1.46 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6121/1/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR#6121
Optional Testsjavac javadoc unit compile shadedjars
unameLinux 19d2a8eaf5a4 5.4.0-182-generic #202-Ubuntu SMP Fri Apr 26 12:29:36 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 2ed3a81
Default JavaEclipse Adoptium-17.0.11+9
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6121/1/testReport/
Max. process+thread count915 (vs. ulimit of 30000)
modulesC: hbase-compression/hbase-compression-aircompressor hbase-compression/hbase-compression-zstd U: hbase-compression
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6121/1/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Apache-HBase commented Jul 25, 2024

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 48sDocker mode activated.
-0 ⚠️yetus0m 5sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+0 🆗mvndep0m 12sMaven dependency ordering for branch
+1 💚mvninstall4m 35sbranch-2 passed
+1 💚compile0m 53sbranch-2 passed
+1 💚javadoc0m 32sbranch-2 passed
+1 💚shadedjars7m 20sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+0 🆗mvndep0m 17sMaven dependency ordering for patch
+1 💚mvninstall3m 52sthe patch passed
+1 💚compile0m 34sthe patch passed
+1 💚javac0m 34sthe patch passed
+1 💚javadoc0m 27sthe patch passed
+1 💚shadedjars6m 21spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
+1 💚unit1m 11shbase-compression-aircompressor in the patch passed.
+1 💚unit3m 11shbase-compression-zstd in the patch passed.
31m 33s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6121/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR#6121
Optional Testsjavac javadoc unit compile shadedjars
unameLinux daeae706e1d7 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 2ed3a81
Default JavaEclipse Adoptium-11.0.23+9
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6121/1/testReport/
Max. process+thread count760 (vs. ulimit of 30000)
modulesC: hbase-compression/hbase-compression-aircompressor hbase-compression/hbase-compression-zstd U: hbase-compression
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6121/1/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Apache-HBase commented Jul 25, 2024

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 58sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗codespell0m 0scodespell was not available.
+0 🆗detsecrets0m 0sdetect-secrets was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
_ branch-2 Compile Tests _
+0 🆗mvndep0m 13sMaven dependency ordering for branch
+1 💚mvninstall4m 36sbranch-2 passed
+1 💚compile0m 56sbranch-2 passed
+1 💚checkstyle0m 21sbranch-2 passed
+1 💚spotbugs0m 57sbranch-2 passed
+1 💚spotless0m 55sbranch has no errors when running spotless:check.
_ Patch Compile Tests _
+0 🆗mvndep0m 17sMaven dependency ordering for patch
+1 💚mvninstall3m 23sthe patch passed
+1 💚compile0m 38sthe patch passed
+1 💚javac0m 38sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚checkstyle0m 17sthe patch passed
+1 💚spotbugs1m 20sthe patch passed
+1 💚hadoopcheck18m 21sPatch does not cause any errors with Hadoop 2.10.2 or 3.3.6 3.4.0.
+1 💚spotless0m 42spatch has no errors when running spotless:check.
_ Other Tests _
+1 💚asflicense0m 17sThe patch does not generate ASF License warnings.
36m 14s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6121/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#6121
Optional Testsdupname asflicense javac spotbugs checkstyle codespell detsecrets compile hadoopcheck hbaseanti spotless
unameLinux 8a70dcf5e300 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 2ed3a81
Default JavaEclipse Adoptium-11.0.23+9
Max. process+thread count77 (vs. ulimit of 30000)
modulesC: hbase-compression/hbase-compression-aircompressor hbase-compression/hbase-compression-zstd U: hbase-compression
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6121/1/console
versionsgit=2.34.1 maven=3.9.8 spotbugs=4.7.3
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@pankaj72981
pankaj72981 merged commit c6e819e into apache:branch-2Jul 25, 2024
pankaj72981 added a commit that referenced this pull request Jul 25, 2024
@pankaj72981
HBASE-28655IllegalArgumentException: Illegal bufferSize thrown when …
93474c5
…hbase.io.compress.zstd.buffersize is not configured (#6114) (#6121)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Vineet Kumar Maheshwari <vineet.4008@gmail.com>
(cherry picked from commit 73f2710)
(cherry picked from commit c6e819e)
pankaj72981 added a commit that referenced this pull request Jul 25, 2024
@pankaj72981
HBASE-28655IllegalArgumentException: Illegal bufferSize thrown when …
deec0aa
…hbase.io.compress.zstd.buffersize is not configured (#6114) (#6121)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Vineet Kumar Maheshwari <vineet.4008@gmail.com>
(cherry picked from commit 73f2710)
(cherry picked from commit c6e819e)
sanjeet006py pushed a commit to sanjeet006py/hbase that referenced this pull request Aug 24, 2025
@pankaj72981@mnpoonia
HBASE-28655 IllegalArgumentException: Illegal bufferSize thrown when …
4a98a93
…hbase.io.compress.zstd.buffersize is not configured (apache#6114) (apache#6121)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Vineet Kumar Maheshwari <vineet.4008@gmail.com>
(cherry picked from commit 73f2710)
(cherry picked from commit c6e819e)
Signed-off-by: apoonia <apoonia@salesforce.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

backportThis PR is a back port of some issue or issues already committed to master

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@pankaj72981@Apache-HBase