Skip to content

HBASE-24402 Moving the meta region causes MetricsException when using above 2.6.0 hadoop version - #1745

Closed
JeongDaeKim wants to merge 1 commit into
apache:branch-1from
JeongDaeKim:branch-1-HBASE-24402
Closed

HBASE-24402 Moving the meta region causes MetricsException when using above 2.6.0 hadoop version#1745
JeongDaeKim wants to merge 1 commit into
apache:branch-1from
JeongDaeKim:branch-1-HBASE-24402

Conversation

@JeongDaeKim

@JeongDaeKimJeongDaeKim commented May 20, 2020

Copy link
Copy Markdown

@JeongDaeKim

JeongDaeKim commented May 21, 2020

Copy link
Copy Markdown
Author

Seems build failed? https://builds.apache.org/view/H-L/view/HBase/job/HBase-PreCommit-GitHub-PR/view/change-requests/job/PR-1745/1/console

Error when executing always post condition:
java.lang.IllegalArgumentException: Failed to prepare archiveArtifacts step
at org.jenkinsci.plugins.workflow.cps.DSL.invokeDescribable(DSL.java:419)
at org.jenkinsci.plugins.workflow.cps.DSL.invokeMethod(DSL.java:182)
at org.jenkinsci.plugins.workflow.cps.CpsScript.invokeMethod(CpsScript.java:122)
at sun.reflect.GeneratedMethodAccessor1274.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1213)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1022)
at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.call(PogoMetaClassSite.java:42)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.kohsuke.groovy.sandbox.impl.Checker$1.call(Checker.java:160)
at org.kohsuke.groovy.sandbox.GroovyInterceptor.onMethodCall(GroovyInterceptor.java:23)
at org.jenkinsci.plugins.scriptsecurity.sandbox.groovy.SandboxInterceptor.onMethodCall(SandboxInterceptor.java:157)
at org.kohsuke.groovy.sandbox.impl.Checker$1.call(Checker.java:158)
at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:162)
at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:132)
at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:132)
at com.cloudbees.groovy.cps.sandbox.SandboxInvoker.methodCall(SandboxInvoker.java:17)
at WorkflowScript.run(WorkflowScript:184)
at ___cps.transform___(Native Method)
at com.cloudbees.groovy.cps.impl.ContinuationGroup.methodCall(ContinuationGroup.java:84)
at com.cloudbees.groovy.cps.impl.FunctionCallBlock$ContinuationImpl.dispatchOrArg(FunctionCallBlock.java:113)
at com.cloudbees.groovy.cps.impl.FunctionCallBlock$ContinuationImpl.fixArg(FunctionCallBlock.java:83)
at sun.reflect.GeneratedMethodAccessor1193.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.cloudbees.groovy.cps.impl.ContinuationPtr$ContinuationImpl.receive(ContinuationPtr.java:72)
at com.cloudbees.groovy.cps.impl.FunctionCallBlock$ContinuationImpl.dispatchOrArg(FunctionCallBlock.java:107)
at com.cloudbees.groovy.cps.impl.FunctionCallBlock$ContinuationImpl.fixArg(FunctionCallBlock.java:83)
at sun.reflect.GeneratedMethodAccessor1193.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.cloudbees.groovy.cps.impl.ContinuationPtr$ContinuationImpl.receive(ContinuationPtr.java:72)
at com.cloudbees.groovy.cps.impl.ContinuationGroup.methodCall(ContinuationGroup.java:87)
at com.cloudbees.groovy.cps.impl.FunctionCallBlock$ContinuationImpl.dispatchOrArg(FunctionCallBlock.java:113)
at com.cloudbees.groovy.cps.impl.FunctionCallBlock$ContinuationImpl.fixArg(FunctionCallBlock.java:83)
at sun.reflect.GeneratedMethodAccessor1193.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.cloudbees.groovy.cps.impl.ContinuationPtr$ContinuationImpl.receive(ContinuationPtr.java:72)
at com.cloudbees.groovy.cps.impl.ConstantBlock.eval(ConstantBlock.java:21)
at com.cloudbees.groovy.cps.Next.step(Next.java:83)
at com.cloudbees.groovy.cps.Continuable$1.call(Continuable.java:174)
at com.cloudbees.groovy.cps.Continuable$1.call(Continuable.java:163)
at org.codehaus.groovy.runtime.GroovyCategorySupport$ThreadCategoryInfo.use(GroovyCategorySupport.java:129)
at org.codehaus.groovy.runtime.GroovyCategorySupport.use(GroovyCategorySupport.java:268)
at com.cloudbees.groovy.cps.Continuable.run0(Continuable.java:163)
at org.jenkinsci.plugins.workflow.cps.SandboxContinuable.access$001(SandboxContinuable.java:18)
at org.jenkinsci.plugins.workflow.cps.SandboxContinuable.run0(SandboxContinuable.java:51)
at org.jenkinsci.plugins.workflow.cps.CpsThread.runNextChunk(CpsThread.java:186)
at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.run(CpsThreadGroup.java:370)
at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.access$200(CpsThreadGroup.java:93)
at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:282)
at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:270)
at org.jenkinsci.plugins.workflow.cps.CpsVmExecutorService$2.call(CpsVmExecutorService.java:66)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:131)
at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:59)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.codehaus.groovy.runtime.InvokerInvocationException: org.jenkinsci.plugins.workflow.steps.MissingContextVariableException: Required context class hudson.FilePath is missing
Perhaps you forgot to surround the code with a step that provides this, such as: node
at org.jenkinsci.plugins.workflow.cps.CpsStepContext.replay(CpsStepContext.java:492)
at org.jenkinsci.plugins.workflow.cps.DSL.invokeStep(DSL.java:317)
at org.jenkinsci.plugins.workflow.cps.DSL.invokeDescribable(DSL.java:417)
at org.jenkinsci.plugins.workflow.cps.DSL.invokeMethod(DSL.java:182)
at org.jenkinsci.plugins.workflow.cps.CpsScript.invokeMethod(CpsScript.java:122)
at sun.reflect.GeneratedMethodAccessor1274.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1213)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1022)
at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.call(PogoMetaClassSite.java:42)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.kohsuke.groovy.sandbox.impl.Checker$1.call(Checker.java:160)
at org.kohsuke.groovy.sandbox.GroovyInterceptor.onMethodCall(GroovyInterceptor.java:23)
at org.jenkinsci.plugins.scriptsecurity.sandbox.groovy.SandboxInterceptor.onMethodCall(SandboxInterceptor.java:157)
at org.kohsuke.groovy.sandbox.impl.Checker$1.call(Checker.java:158)
at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:162)
at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:132)
at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:132)
at com.cloudbees.groovy.cps.sandbox.SandboxInvoker.methodCall(SandboxInvoker.java:17)
... 44 more
Caused by: org.jenkinsci.plugins.workflow.steps.MissingContextVariableException: Required context class hudson.FilePath is missing
Perhaps you forgot to surround the code with a step that provides this, such as: node
at org.jenkinsci.plugins.workflow.steps.StepDescriptor.checkContextAvailability(StepDescriptor.java:266)
at org.jenkinsci.plugins.workflow.cps.DSL.invokeStep(DSL.java:263)
... 65 more

I have no idea why this failure occured...

@Apache-HBase

Apache-HBase commented May 22, 2020

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec13m 44sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ branch-1 Compile Tests _
+1 💚mvninstall9m 58sbranch-1 passed
+1 💚compile0m 14sbranch-1 passed with JDK v1.8.0_252
+1 💚compile0m 17sbranch-1 passed with JDK v1.7.0_262
+1 💚checkstyle0m 24sbranch-1 passed
+1 💚shadedjars3m 23sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 31sbranch-1 passed with JDK v1.8.0_252
+1 💚javadoc0m 19sbranch-1 passed with JDK v1.7.0_262
+0 🆗spotbugs1m 2sUsed deprecated FindBugs config; considering switching to SpotBugs.
+1 💚findbugs0m 59sbranch-1 passed
_ Patch Compile Tests _
+1 💚mvninstall2m 4sthe patch passed
+1 💚compile0m 14sthe patch passed with JDK v1.8.0_252
+1 💚javac0m 14sthe patch passed
+1 💚compile0m 17sthe patch passed with JDK v1.7.0_262
+1 💚javac0m 17sthe patch passed
+1 💚checkstyle0m 15shbase-hadoop2-compat: The patch generated 0 new + 2 unchanged - 1 fixed = 2 total (was 3)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚shadedjars3m 4spatch has no errors when building our shaded downstream artifacts.
+1 💚hadoopcheck4m 59sPatch does not cause any errors with Hadoop 2.8.5 2.9.2.
+1 💚javadoc0m 16sthe patch passed with JDK v1.8.0_252
+1 💚javadoc0m 17sthe patch passed with JDK v1.7.0_262
+1 💚findbugs0m 51sthe patch passed
_ Other Tests _
+1 💚unit0m 37shbase-hadoop2-compat in the patch passed.
+1 💚asflicense0m 20sThe patch does not generate ASF License warnings.
46m 53s
SubsystemReport/Notes
DockerClient=19.03.9 Server=19.03.9 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1745/1/artifact/out/Dockerfile
GITHUB PR#1745
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 7bd57558bf9f 4.15.0-101-generic #102-Ubuntu SMP Mon May 11 10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1745/out/precommit/personality/provided.sh
git revisionbranch-1 / 3235b56
Default Java1.7.0_262
Multi-JDK versions/usr/lib/jvm/zulu-8-amd64:1.8.0_252 /usr/lib/jvm/zulu-7-amd64:1.7.0_262
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1745/1/testReport/
Max. process+thread count77 (vs. ulimit of 10000)
modulesC: hbase-hadoop2-compat U: hbase-hadoop2-compat
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1745/1/console
versionsgit=1.9.1 maven=3.0.5 findbugs=3.0.1
Powered byApache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

@JeongDaeKim
JeongDaeKimforce-pushed the branch-1-HBASE-24402 branch from 755da2c to 62df227CompareMay 25, 2020 06:33
@Apache-HBase

Apache-HBase commented May 25, 2020

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec7m 5sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 1sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ branch-1 Compile Tests _
+1 💚mvninstall9m 46sbranch-1 passed
+1 💚compile0m 15sbranch-1 passed with JDK v1.8.0_252
+1 💚compile0m 18sbranch-1 passed with JDK v1.7.0_262
+1 💚checkstyle0m 26sbranch-1 passed
+1 💚shadedjars3m 2sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 31sbranch-1 passed with JDK v1.8.0_252
+1 💚javadoc0m 19sbranch-1 passed with JDK v1.7.0_262
+0 🆗spotbugs1m 1sUsed deprecated FindBugs config; considering switching to SpotBugs.
+1 💚findbugs0m 57sbranch-1 passed
_ Patch Compile Tests _
+1 💚mvninstall1m 51sthe patch passed
+1 💚compile0m 15sthe patch passed with JDK v1.8.0_252
+1 💚javac0m 15sthe patch passed
+1 💚compile0m 19sthe patch passed with JDK v1.7.0_262
+1 💚javac0m 19sthe patch passed
+1 💚checkstyle0m 16shbase-hadoop2-compat: The patch generated 0 new + 2 unchanged - 1 fixed = 2 total (was 3)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚shadedjars2m 50spatch has no errors when building our shaded downstream artifacts.
+1 💚hadoopcheck4m 40sPatch does not cause any errors with Hadoop 2.8.5 2.9.2.
+1 💚javadoc0m 14sthe patch passed with JDK v1.8.0_252
+1 💚javadoc0m 18sthe patch passed with JDK v1.7.0_262
+1 💚findbugs0m 50sthe patch passed
_ Other Tests _
+1 💚unit0m 37shbase-hadoop2-compat in the patch passed.
+1 💚asflicense0m 21sThe patch does not generate ASF License warnings.
38m 36s
SubsystemReport/Notes
DockerClient=19.03.9 Server=19.03.9 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1745/2/artifact/out/Dockerfile
GITHUB PR#1745
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux dc8388090280 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1745/out/precommit/personality/provided.sh
git revisionbranch-1 / 3235b56
Default Java1.7.0_262
Multi-JDK versions/usr/lib/jvm/zulu-8-amd64:1.8.0_252 /usr/lib/jvm/zulu-7-amd64:1.7.0_262
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1745/2/testReport/
Max. process+thread count87 (vs. ulimit of 10000)
modulesC: hbase-hadoop2-compat U: hbase-hadoop2-compat
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1745/2/console
versionsgit=1.9.1 maven=3.0.5 findbugs=3.0.1
Powered byApache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

thangTang
thangTang approved these changes Jun 5, 2020
View reviewed changes

@thangTangthangTang left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good patch. It works for me.

@JeongDaeKim

JeongDaeKim commented Jun 16, 2020

Copy link
Copy Markdown
Author

@thangTang Thank you for the review!
I'm still waiting for other's opinion, but no one seems not interested in this PR 😢

@Apache-HBase

Apache-HBase commented Oct 15, 2020

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 21sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ branch-1 Compile Tests _
+1 💚mvninstall10m 9sbranch-1 passed
+1 💚compile0m 17sbranch-1 passed with JDK v1.8.0_262
+1 💚compile0m 19sbranch-1 passed with JDK v1.7.0_272
+1 💚checkstyle0m 26sbranch-1 passed
+1 💚shadedjars3m 34sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 32sbranch-1 passed with JDK v1.8.0_262
+1 💚javadoc0m 19sbranch-1 passed with JDK v1.7.0_272
+0 🆗spotbugs1m 6sUsed deprecated FindBugs config; considering switching to SpotBugs.
+1 💚findbugs1m 1sbranch-1 passed
_ Patch Compile Tests _
+1 💚mvninstall2m 36sthe patch passed
+1 💚compile0m 15sthe patch passed with JDK v1.8.0_262
+1 💚javac0m 15sthe patch passed
+1 💚compile0m 19sthe patch passed with JDK v1.7.0_272
+1 💚javac0m 19sthe patch passed
+1 💚checkstyle0m 17shbase-hadoop2-compat: The patch generated 0 new + 2 unchanged - 1 fixed = 2 total (was 3)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚shadedjars3m 22spatch has no errors when building our shaded downstream artifacts.
+1 💚hadoopcheck5m 19sPatch does not cause any errors with Hadoop 2.8.5 2.9.2.
+1 💚javadoc0m 15sthe patch passed with JDK v1.8.0_262
+1 💚javadoc0m 19sthe patch passed with JDK v1.7.0_272
+1 💚findbugs0m 57sthe patch passed
_ Other Tests _
+1 💚unit0m 38shbase-hadoop2-compat in the patch passed.
+1 💚asflicense0m 22sThe patch does not generate ASF License warnings.
36m 25s
SubsystemReport/Notes
DockerClient=19.03.13 Server=19.03.13 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-1745/4/artifact/out/Dockerfile
GITHUB PR#1745
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 1e9bff93ba52 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-agent/workspace/Base-PreCommit-GitHub-PR_PR-1745/out/precommit/personality/provided.sh
git revisionbranch-1 / e4a8dcc
Default Java1.7.0_272
Multi-JDK versions/usr/lib/jvm/zulu-8-amd64:1.8.0_262 /usr/lib/jvm/zulu-7-amd64:1.7.0_272
Test Resultshttps://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-1745/4/testReport/
Max. process+thread count77 (vs. ulimit of 10000)
modulesC: hbase-hadoop2-compat U: hbase-hadoop2-compat
Console outputhttps://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-1745/4/console
versionsgit=1.9.1 maven=3.0.5 findbugs=3.0.1
Powered byApache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

@Apache9Apache9 closed this Aug 9, 2022
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@thangTangthangTangthangTang approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@JeongDaeKim@Apache-HBase@thangTang@Apache9