Skip to content

HBASE-23181 Blocked WAL archive: "LogRoller: Failed to schedule flush of XXXX, because it is not online on us" - #742

Closed
saintstack wants to merge 1 commit into
apache:branch-2from
saintstack:HBASE-23181
Closed

HBASE-23181 Blocked WAL archive: "LogRoller: Failed to schedule flush of XXXX, because it is not online on us"#742
saintstack wants to merge 1 commit into
apache:branch-2from
saintstack:HBASE-23181

Conversation

@saintstack

Copy link
Copy Markdown
Contributor

… of XXXX, because it is not online on us"

Fix is moving a line in HRegion to close a gap that would allow an old
edit to sneak into the backing SequenceIdAccounting datastructure.
The below line gets moved up before wal.startCacheFlush:

  •  flushOpSeqId = getNextSequenceId(wal);
    

We change the LogRoller constructor to remove redundant param. It will
also call the temporary,ugly purge method (To be removed if we've found
fix...). Because of constructor chagne, need to change also
TestFailedAppendAndSync, TestWALLockup, TestAsyncFSWAL &
WALPerformanceEvaluation.java

We add a purge method called when something is wrong to AbstractFSWAL.java
Need to be removed when 'fix' is in place.

SequenceIdAccounting gets a purge method called when we find lagging
records.

… of XXXX, because it is not online on us"
Fix is moving a line in HRegion to close a gap that would allow an old
edit to sneak into the backing SequenceIdAccounting datastructure.
The below line gets moved up before wal.startCacheFlush:
- flushOpSeqId = getNextSequenceId(wal);
We change the LogRoller constructor to remove redundant param. It will
also call the temporary,ugly purge method (To be removed if we've found
fix...). Because of constructor chagne, need to change also
TestFailedAppendAndSync, TestWALLockup, TestAsyncFSWAL &
WALPerformanceEvaluation.java
We add a purge method called when something is wrong to AbstractFSWAL.java
Need to be removed when 'fix' is in place.
SequenceIdAccounting gets a purge method called when we find lagging
records.
@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
💙reexec0m 35sDocker mode activated.
_ Prechecks _
💚dupname0m 0sNo case conflicting files found.
💚hbaseanti0m 0sPatch does not have any anti-patterns.
💚@author0m 0sThe patch does not contain any @author tags.
💚test4tests0m 0sThe patch appears to include 4 new or modified test files.
_ branch-2 Compile Tests _
💚mvninstall6m 53sbranch-2 passed
💚compile1m 12sbranch-2 passed
💚checkstyle1m 54sbranch-2 passed
💚shadedjars5m 49sbranch has no errors when building our shaded downstream artifacts.
💚javadoc0m 52sbranch-2 passed
💙spotbugs4m 57sUsed deprecated FindBugs config; considering switching to SpotBugs.
💚findbugs4m 54sbranch-2 passed
_ Patch Compile Tests _
💚mvninstall6m 12sthe patch passed
💚compile1m 11sthe patch passed
💚javac1m 12sthe patch passed
💚checkstyle2m 11shbase-server: The patch generated 0 new + 320 unchanged - 9 fixed = 320 total (was 329)
💚whitespace0m 0sThe patch has no whitespace issues.
💚shadedjars5m 35spatch has no errors when building our shaded downstream artifacts.
💚hadoopcheck20m 19sPatch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
💚javadoc0m 36sthe patch passed
💔findbugs3m 31shbase-server generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
_ Other Tests _
💚unit166m 8shbase-server in the patch passed.
💚asflicense0m 26sThe patch does not generate ASF License warnings.
236m 39s
ReasonTests
FindBugsmodule:hbase-server
Should org.apache.hadoop.hbase.regionserver.LogRoller$NotOnlineException be a static inner class? At LogRoller.java:inner class? At LogRoller.java:[lines 221-223]
SubsystemReport/Notes
DockerClient=19.03.4 Server=19.03.4 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-742/1/artifact/out/Dockerfile
GITHUB PR#742
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 2fc48ea937f6 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-742/out/precommit/personality/provided.sh
git revisionbranch-2 / ee6897b
Default Java1.8.0_181
findbugshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-742/1/artifact/out/new-findbugs-hbase-server.html
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-742/1/testReport/
Max. process+thread count4269 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-742/1/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.11.0 https://yetus.apache.org

This message was automatically generated.

@Apache9Apache9 closed this Oct 26, 2019
@Apache9

Copy link
Copy Markdown
Contributor

We use #753 finally.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@saintstack@Apache-HBase@Apache9