Skip to content

HBASE-27033 Backport "HBASE-27013 Introduce read all bytes when using… - #4429

Merged
taklwu merged 1 commit into
apache:branch-2.4from
taklwu:HBASE-27033
May 16, 2022
Merged

HBASE-27033 Backport "HBASE-27013 Introduce read all bytes when using…#4429
taklwu merged 1 commit into
apache:branch-2.4from
taklwu:HBASE-27033

Conversation

@taklwu

Copy link
Copy Markdown
Contributor

… pread for prefetch"

  • introduce optional flag hfile.pread.all.bytes.enabled for pread that must read full bytes with the next block header

… pread for prefetch"
- introduce optional flag `hfile.pread.all.bytes.enabled` for pread that must read full bytes with the next block header
@taklwu
taklwu requested a review from joshelserMay 13, 2022 21:29
@taklwu

Copy link
Copy Markdown
ContributorAuthor

please see the original commit from branch-2 43e8c11

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 15sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
_ branch-2.4 Compile Tests _
+0 🆗mvndep0m 12sMaven dependency ordering for branch
+1 💚mvninstall2m 2sbranch-2.4 passed
+1 💚compile2m 42sbranch-2.4 passed
+1 💚checkstyle0m 44sbranch-2.4 passed
+1 💚spotless0m 42sbranch has no errors when running spotless:check.
+1 💚spotbugs1m 41sbranch-2.4 passed
_ Patch Compile Tests _
+0 🆗mvndep0m 9sMaven dependency ordering for patch
+1 💚mvninstall1m 55sthe patch passed
+1 💚compile2m 39sthe patch passed
+1 💚javac2m 39sthe patch passed
+1 💚checkstyle0m 43sthe patch passed
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚hadoopcheck10m 18sPatch does not cause any errors with Hadoop 2.10.0 or 3.1.2 3.2.1.
+1 💚spotless0m 39spatch has no errors when running spotless:check.
+1 💚spotbugs1m 52sthe patch passed
_ Other Tests _
+1 💚asflicense0m 18sThe patch does not generate ASF License warnings.
32m 54s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4429/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#4429
Optional Testsdupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile
unameLinux 26475f694390 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2.4 / aa7f982
Default JavaAdoptOpenJDK-1.8.0_282-b08
Max. process+thread count65 (vs. ulimit of 12500)
modulesC: hbase-common hbase-server U: .
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4429/1/console
versionsgit=2.17.1 maven=3.6.3 spotbugs=4.2.2
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 53sDocker mode activated.
-0 ⚠️yetus0m 6sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ branch-2.4 Compile Tests _
+0 🆗mvndep0m 51sMaven dependency ordering for branch
+1 💚mvninstall2m 55sbranch-2.4 passed
+1 💚compile0m 43sbranch-2.4 passed
+1 💚shadedjars4m 13sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 33sbranch-2.4 passed
_ Patch Compile Tests _
+0 🆗mvndep0m 10sMaven dependency ordering for patch
+1 💚mvninstall1m 49sthe patch passed
+1 💚compile0m 43sthe patch passed
+1 💚javac0m 43sthe patch passed
+1 💚shadedjars4m 7spatch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 31sthe patch passed
_ Other Tests _
+1 💚unit1m 10shbase-common in the patch passed.
+1 💚unit163m 10shbase-server in the patch passed.
183m 36s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4429/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR#4429
Optional Testsjavac javadoc unit shadedjars compile
unameLinux fe4fe894e9e0 5.4.0-1071-aws #76~18.04.1-Ubuntu SMP Mon Mar 28 17:49:57 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2.4 / aa7f982
Default JavaAdoptOpenJDK-1.8.0_282-b08
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4429/1/testReport/
Max. process+thread count2596 (vs. ulimit of 12500)
modulesC: hbase-common hbase-server U: .
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4429/1/console
versionsgit=2.17.1 maven=3.6.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec4m 15sDocker mode activated.
-0 ⚠️yetus0m 5sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ branch-2.4 Compile Tests _
+0 🆗mvndep0m 48sMaven dependency ordering for branch
+1 💚mvninstall3m 44sbranch-2.4 passed
+1 💚compile1m 3sbranch-2.4 passed
+1 💚shadedjars5m 21sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 45sbranch-2.4 passed
_ Patch Compile Tests _
+0 🆗mvndep0m 17sMaven dependency ordering for patch
+1 💚mvninstall2m 44sthe patch passed
+1 💚compile1m 1sthe patch passed
+1 💚javac1m 1sthe patch passed
+1 💚shadedjars4m 47spatch has no errors when building our shaded downstream artifacts.
-0 ⚠️javadoc0m 13shbase-common generated 1 new + 15 unchanged - 0 fixed = 16 total (was 15)
_ Other Tests _
+1 💚unit1m 22shbase-common in the patch passed.
+1 💚unit166m 50shbase-server in the patch passed.
196m 21s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4429/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR#4429
Optional Testsjavac javadoc unit shadedjars compile
unameLinux 8ca541518d0c 5.4.0-1068-aws #72~18.04.1-Ubuntu SMP Thu Mar 3 08:49:49 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2.4 / aa7f982
Default JavaAdoptOpenJDK-11.0.10+9
javadochttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4429/1/artifact/yetus-jdk11-hadoop3-check/output/diff-javadoc-javadoc-hbase-common.txt
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4429/1/testReport/
Max. process+thread count2850 (vs. ulimit of 12500)
modulesC: hbase-common hbase-server U: .
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4429/1/console
versionsgit=2.17.1 maven=3.6.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@joshelserjoshelser left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Backport lgtm (should not have a change in functionality to the 2.4 line). Looks like you also already have jira marked for 2.4.13 rather than the in-flight 2.4.12)

Comment on lines +1455 to +1457
if (
!BlockIOUtils.preadWithExtra(dest, istream, fileOffset, size, extraSize, isPreadAllBytes)
) {

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
if (
!BlockIOUtils.preadWithExtra(dest, istream, fileOffset, size, extraSize, isPreadAllBytes)
) {
if (!BlockIOUtils.preadWithExtra(
dest, istream, fileOffset, size, extraSize, isPreadAllBytes)) {

Typically, we break long lines with method invocations around the arguments, rather than break up the if condition itself.

However, if checkstyle is happy with this how it is, then it's fine :)

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

that was modified by spotless:apply, and yet the checkstyle was happy about it

@taklwu
taklwu merged commit 5b31975 into apache:branch-2.4May 16, 2022
vinayakphegde pushed a commit to vinayakphegde/hbase that referenced this pull request Apr 4, 2024
… pread for prefetch" (apache#4429)
- introduce optional flag `hfile.pread.all.bytes.enabled` for pread that must read full bytes with the next block header
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
(cherry picked from commit 5b31975)
Change-Id: I6caba0ad25e8feb38f6b7d45ea957e5890ab8154
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@taklwu@Apache-HBase@joshelser@ankitsinghal