Skip to content

HBASE-27698 Migrate meta locations from zookeeper to master data may … - #5167

Open
chrajeshbabu wants to merge 1 commit into
apache:branch-2from
chrajeshbabu:HBASE-27698
Open

HBASE-27698 Migrate meta locations from zookeeper to master data may …#5167
chrajeshbabu wants to merge 1 commit into
apache:branch-2from
chrajeshbabu:HBASE-27698

Conversation

@chrajeshbabu

Copy link
Copy Markdown
Contributor

…not always possible if we migrate from 1.x HBase

…not always possible if we migrate from 1.x HBase
@chrajeshbabu
chrajeshbabu requested a review from taklwuApril 9, 2023 18:52
@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 8sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
_ branch-2 Compile Tests _
+1 💚mvninstall3m 39sbranch-2 passed
+1 💚compile2m 25sbranch-2 passed
+1 💚checkstyle0m 37sbranch-2 passed
+1 💚spotless0m 43sbranch has no errors when running spotless:check.
+1 💚spotbugs1m 31sbranch-2 passed
_ Patch Compile Tests _
+1 💚mvninstall3m 20sthe patch passed
+1 💚compile2m 23sthe patch passed
+1 💚javac2m 23sthe patch passed
+1 💚checkstyle0m 34sthe patch passed
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚hadoopcheck17m 45sPatch does not cause any errors with Hadoop 2.10.2 or 3.2.4 3.3.4.
+1 💚spotless0m 42spatch has no errors when running spotless:check.
+1 💚spotbugs1m 35sthe patch passed
_ Other Tests _
+1 💚asflicense0m 13sThe patch does not generate ASF License warnings.
38m 26s
SubsystemReport/Notes
DockerClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#5167
Optional Testsdupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile
unameLinux eed655c843a8 5.4.0-144-generic #161-Ubuntu SMP Fri Feb 3 14:49:04 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / a67a8f7
Default JavaEclipse Adoptium-11.0.17+8
Max. process+thread count86 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/console
versionsgit=2.34.1 maven=3.8.6 spotbugs=4.7.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 49sDocker mode activated.
-0 ⚠️yetus0m 6sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+1 💚mvninstall4m 52sbranch-2 passed
+1 💚compile0m 49sbranch-2 passed
+1 💚shadedjars5m 26sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 28sbranch-2 passed
_ Patch Compile Tests _
+1 💚mvninstall4m 7sthe patch passed
+1 💚compile0m 48sthe patch passed
+1 💚javac0m 48sthe patch passed
+1 💚shadedjars5m 10spatch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 25sthe patch passed
_ Other Tests _
-1 ❌unit205m 19shbase-server in the patch failed.
232m 18s
SubsystemReport/Notes
DockerClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR#5167
Optional Testsjavac javadoc unit shadedjars compile
unameLinux d013c5df2212 5.4.0-1097-aws #105~18.04.1-Ubuntu SMP Mon Feb 13 17:50:57 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / a67a8f7
Default JavaEclipse Adoptium-11.0.17+8
unithttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/testReport/
Max. process+thread count2750 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/console
versionsgit=2.34.1 maven=3.8.6
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 56sDocker mode activated.
-0 ⚠️yetus0m 4sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+1 💚mvninstall2m 59sbranch-2 passed
+1 💚compile0m 40sbranch-2 passed
+1 💚shadedjars4m 10sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 25sbranch-2 passed
_ Patch Compile Tests _
+1 💚mvninstall2m 42sthe patch passed
+1 💚compile0m 41sthe patch passed
+1 💚javac0m 41sthe patch passed
+1 💚shadedjars4m 12spatch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 24sthe patch passed
_ Other Tests _
-1 ❌unit218m 44shbase-server in the patch failed.
240m 24s
SubsystemReport/Notes
DockerClientAPI=1.42 ServerAPI=1.42 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR#5167
Optional Testsjavac javadoc unit shadedjars compile
unameLinux ec9a8276b47e 5.4.0-137-generic #154-Ubuntu SMP Thu Jan 5 17:03:22 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / a67a8f7
Default JavaTemurin-1.8.0_352-b08
unithttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/artifact/yetus-jdk8-hadoop2-check/output/patch-unit-hbase-server.txt
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/testReport/
Max. process+thread count2192 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/console
versionsgit=2.34.1 maven=3.8.6
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@chrajeshbabu

Copy link
Copy Markdown
ContributorAuthor

The test case failures are not related to this change. @taklwu could you please review the change. Thanks.

@Apache9

Copy link
Copy Markdown
Contributor

Why change from throwing an exception to returning false?

@chrajeshbabu

chrajeshbabu commented Apr 11, 2023

Copy link
Copy Markdown
ContributorAuthor

Why change from throwing an exception to returning false?

@Apache9
During the express upgrade as mentioned in comment here there is no way to to detect the meta location in the cluster because meta location znode as well as meta wal file gets deleted when the region server stopped gracefully. So region states info for meta is not getting added which leads to init meta procedure. During the meta initialization checking whether any meta table directory present in the cluster or not, if present and proper then we are throwing the IOException saying meta need to be rebuild or meta znode should be created manually. Since this procedure persisted and cannot proceed further even with multiple restarts of master until unless manual steps of meta rebuild or znode creation and procedure store deletion are performed. All these manual steps are error prone and not required because during graceful shutdowns of cluster anyway meta won't be assigned to any server so allowing meta assignment to random server during init meta procedure is correct that is what happening with my patch. Returning false because just to log that meta table directory is not deleted.

Here I have mentioned how the upgrade went smooth with my patch.

@virajjasani

Copy link
Copy Markdown
Contributor

Thank you @chrajeshbabu. It seems the changes make sense from the upgrade viewpoint. On the other hand, if this rare scenario were to happen on a healthy 2.x cluster, does this change make any difference?

All these manual steps are error prone and not required because during graceful shutdowns of cluster anyway meta won't be assigned to any server so allowing meta assignment to random server during init meta procedure is correct that is what happening with my patch. Returning false because just to log that meta table directory is not deleted.

If this happens on 2.x cluster, what would now be different? Only that meta would be assigned on any random server, correct?

@chrajeshbabu

Copy link
Copy Markdown
ContributorAuthor

Thank you @chrajeshbabu. It seems the changes make sense from the upgrade viewpoint. On the other hand, if this rare scenario were to happen on a healthy 2.x cluster, does this change make any difference?

If this happens on 2.x cluster, what would now be different? Only that meta would be assigned on any random server, >correct?

I have tried two scenarios in healthy 2.x cluster with the change

  1. Removed zookeeper data alone and restarted cluster, things came up properly
  2. Removed both zookeeper data as well as master data so that we hit the same scenario of meta initialisation procedure, meta region assigned to random server and one server regions came up properly and remaining servers become unknown(this is not related to this issue will check why it's happening and work on another JIRA), recovered those with hbck2 scheduleRecoveries option and cluster is normal.

By throwing exception also we need to delete master data because of failed init meta procedure not bring the master up and need to follow one of these steps

  1. meta server znode creation which can also leads to unknown servers issue(we should use hbck2 to recover)
    2)delete meta table data in hdfs and rebuild completely which is error prone and exact state of meta may not build sometimes because tables state missing in zookeeper etc...

@virajjasani

Copy link
Copy Markdown
Contributor

Got it, thanks. This makes sense, +1 from my side.

@virajjasani

Copy link
Copy Markdown
Contributor

@Apache9 does this look good to you?

@chrajeshbabu

Copy link
Copy Markdown
ContributorAuthor

@Apache9 will commit it if it's fine for you. Could you please confirm.

@Apache9

Copy link
Copy Markdown
Contributor

I still need to check the code.

This is a very critical part, if we run InitMetaProcedure when meta exists, it could cause serious data loss problem...

We should try to prevent scheduling the InitMetaProcedure, instead of just letting it go and hoping it would work...

@Apache9

Copy link
Copy Markdown
Contributor

After chekcing the code, I think the correct way for fixing this problem is to do the work in HMaster.tryMigrateMetaLocationsFromZooKeeper. We can some more code in this method, to check whether the meta directory is already there and if it is, if we can make sure that this is an upgrading from 1.x(by trying to read something on the filesystem? Is this possible?), then insert a record to the master region so we can skip scheduling the InitMetaProcedure.

@chrajeshbabu

Copy link
Copy Markdown
ContributorAuthor

to check whether the meta directory is already there and if it is, if we can make sure that this is an upgrading from 1.x(by trying to read something on the filesystem? Is this possible?)

we can check the column families in meta table to detect whether it's from 1.x or current versions.

@Apache9

Copy link
Copy Markdown
Contributor

And do we have read replica support on 1.x? Do we also need to insert the record for secondary replicas?

@chrajeshbabu

Copy link
Copy Markdown
ContributorAuthor

then insert a record to the master region so we can skip scheduling the InitMetaProcedure.

We can insert record but we may not know the state and location which leads to InitMetaProcedure again.

@Apache9

Copy link
Copy Markdown
Contributor

then insert a record to the master region so we can skip scheduling the InitMetaProcedure.

We can insert record but we may not know the state and location which leads to InitMetaProcedure again.

Checked the code, the condition for whether to schedule an InitMetaProcedure is

if (!this.assignmentManager.getRegionStates().hasTableRegionStates(TableName.META_TABLE_NAME)) {

So I think it only needs we have a record in master region for meta, and do not need to know its state and location?

And we will first try to migrate from zookeeper, and for 1.x, if the cluster shutdown gracefully, there is no znode for meta, then we can enter the logic described above, so in this case, I think the state for meta should be CLOSED?

@chrajeshbabu

Copy link
Copy Markdown
ContributorAuthor

So I think it only needs we have a record in master region for meta, and do not need to know its state and location?

And we will first try to migrate from zookeeper, and for 1.x, if the cluster shutdown gracefully, there is no znode for meta, then we can enter the logic described above, so in this case, I think the state for meta should be CLOSED?

That's correct let me check and update the patch accordingly.

@virajjasani

Copy link
Copy Markdown
Contributor

to check whether the meta directory is already there and if it is, if we can make sure that this is an upgrading from 1.x(by trying to read something on the filesystem? Is this possible?)

we can check the column families in meta table to detect whether it's from 1.x or current versions.

@chrajeshbabu but isn't meta state unknown in your case of migration from 1.x to 2.x? Is the plan to read meta CF from filesystem directly as part of tryMigrateMetaLocationsFromZooKeeper?

@chrajeshbabu

chrajeshbabu commented May 8, 2023

Copy link
Copy Markdown
ContributorAuthor

@Apache9 I have tried your suggestion of creating put entry of meta table in master region which gets filled in regionstates and helps to avoid calling init meta procedure there is problem with this approach.
Actually meta assignment called only two places 1) during server crash procedure when the region server went down is carrying meta this is not the case during the express upgrade cases 2) during meta initialisation once after the fs layout creation step is done.
By adding the just meta entry in the master region without knowing the location, won't reach any of the above flows and leading to meta region hanging in transition forever.

Here is the code I have tried.

} else { TableDescriptor metaTableDescriptor = tableDescriptors.get(TableName.META_TABLE_NAME); if(metaTableDescriptor != null && metaTableDescriptor.getColumnFamily(TABLE_FAMILY) == null) { MetaTableAccessor.addRegionInfo(put, RegionInfoBuilder.FIRST_META_REGIONINFO); put.add(CellBuilderFactory.create(CellBuilderType.SHALLOW_COPY).setRow(put.getRow()) .setFamily(HConstants.CATALOG_FAMILY) .setQualifier(RegionStateStore.getStateColumn(RegionInfoBuilder.FIRST_META_REGIONINFO.getReplicaId())).setTimestamp(put.getTimestamp()) .setType(Cell.Type.Put).setValue(Bytes.toBytes(RegionState.State.CLOSED.name())).build()); LOG.info(info.toString()); masterRegion.update(r -> r.put(put)); }

@Apache9

Copy link
Copy Markdown
Contributor

@Apache9 I have tried your suggestion of creating put entry of meta table in master region which gets filled in regionstates and helps to avoid calling init meta procedure there is problem with this approach. Actually meta assignment called only two places 1) during server crash procedure when the region server went down is carrying meta this is not the case during the express upgrade cases 2) during meta initialisation once after the fs layout creation step is done. By adding the just meta entry in the master region without knowing the location, won't reach any of the above flows and leading to meta region hanging in transition forever.

Here is the code I have tried.

} else { TableDescriptor metaTableDescriptor = tableDescriptors.get(TableName.META_TABLE_NAME); if(metaTableDescriptor != null && metaTableDescriptor.getColumnFamily(TABLE_FAMILY) == null) { MetaTableAccessor.addRegionInfo(put, RegionInfoBuilder.FIRST_META_REGIONINFO); put.add(CellBuilderFactory.create(CellBuilderType.SHALLOW_COPY).setRow(put.getRow()) .setFamily(HConstants.CATALOG_FAMILY) .setQualifier(RegionStateStore.getStateColumn(RegionInfoBuilder.FIRST_META_REGIONINFO.getReplicaId())).setTimestamp(put.getTimestamp()) .setType(Cell.Type.Put).setValue(Bytes.toBytes(RegionState.State.CLOSED.name())).build()); LOG.info(info.toString()); masterRegion.update(r -> r.put(put)); }

Better post the full patch somewhere so I can check it? And maybe we need to manually schedule a TRSP to bring meta region online in this case...

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec1m 40sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗codespell0m 0scodespell was not available.
+0 🆗detsecrets0m 0sdetect-secrets was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
_ branch-2 Compile Tests _
+1 💚mvninstall2m 36sbranch-2 passed
+1 💚compile2m 17sbranch-2 passed
+1 💚checkstyle0m 28sbranch-2 passed
+1 💚spotbugs1m 10sbranch-2 passed
-1 ❌spotless0m 32sbranch has 66 errors when running spotless:check, run spotless:apply to fix.
_ Patch Compile Tests _
+1 💚mvninstall2m 10sthe patch passed
+1 💚compile2m 13sthe patch passed
+1 💚javac2m 13sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚checkstyle0m 27sthe patch passed
+1 💚spotbugs1m 12sthe patch passed
+1 💚hadoopcheck11m 44sPatch does not cause any errors with Hadoop 2.10.2 or 3.3.6 3.4.1.
-1 ❌spotless0m 27spatch has 66 errors when running spotless:check, run spotless:apply to fix.
_ Other Tests _
+1 💚asflicense0m 9sThe patch does not generate ASF License warnings.
28m 18s
SubsystemReport/Notes
DockerClientAPI=1.48 ServerAPI=1.48 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#5167
Optional Testsdupname asflicense javac spotbugs checkstyle codespell detsecrets compile hadoopcheck hbaseanti spotless
unameLinux 52a7d6c767b4 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 37bdf1d
Default JavaEclipse Adoptium-11.0.23+9
spotlesshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/artifact/yetus-general-check/output/branch-spotless.txt
spotlesshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/artifact/yetus-general-check/output/patch-spotless.txt
Max. process+thread count80 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/console
versionsgit=2.34.1 maven=3.9.8 spotbugs=4.7.3
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 48sDocker mode activated.
-0 ⚠️yetus0m 6sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+1 💚mvninstall3m 30sbranch-2 passed
+1 💚compile0m 57sbranch-2 passed
+1 💚javadoc0m 28sbranch-2 passed
+1 💚shadedjars6m 28sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+1 💚mvninstall3m 3sthe patch passed
+1 💚compile0m 58sthe patch passed
+1 💚javac0m 58sthe patch passed
+1 💚javadoc0m 28sthe patch passed
+1 💚shadedjars6m 23spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
+1 💚unit204m 27shbase-server in the patch passed.
232m 1s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR#5167
Optional Testsjavac javadoc unit compile shadedjars
unameLinux fa25c424743a 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 37bdf1d
Default JavaEclipse Adoptium-17.0.11+9
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/testReport/
Max. process+thread count3253 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 12sDocker mode activated.
-0 ⚠️yetus0m 6sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+1 💚mvninstall3m 12sbranch-2 passed
+1 💚compile0m 49sbranch-2 passed
+1 💚javadoc0m 34sbranch-2 passed
+1 💚shadedjars6m 32sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+1 💚mvninstall3m 28sthe patch passed
+1 💚compile0m 54sthe patch passed
+1 💚javac0m 54sthe patch passed
+1 💚javadoc0m 25sthe patch passed
+1 💚shadedjars5m 48spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
+1 💚unit219m 6shbase-server in the patch passed.
244m 54s
SubsystemReport/Notes
DockerClientAPI=1.48 ServerAPI=1.48 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR#5167
Optional Testsjavac javadoc unit compile shadedjars
unameLinux 1a47d04a4b75 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 37bdf1d
Default JavaEclipse Adoptium-11.0.23+9
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/testReport/
Max. process+thread count3531 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec1m 1sDocker mode activated.
-0 ⚠️yetus0m 6sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+1 💚mvninstall3m 30sbranch-2 passed
+1 💚compile1m 4sbranch-2 passed
+1 💚javadoc0m 39sbranch-2 passed
+1 💚shadedjars7m 0sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+1 💚mvninstall3m 25sthe patch passed
+1 💚compile1m 4sthe patch passed
+1 💚javac1m 4sthe patch passed
+1 💚javadoc0m 35sthe patch passed
+1 💚shadedjars6m 49spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
+1 💚unit273m 28shbase-server in the patch passed.
303m 35s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR#5167
Optional Testsjavac javadoc unit compile shadedjars
unameLinux 82beeb092022 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 37bdf1d
Default JavaTemurin-1.8.0_412-b08
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/testReport/
Max. process+thread count3227 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5167/1/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@chrajeshbabu@Apache-HBase@Apache9@virajjasani