Skip to content

HBASE-13798 TestFromClientSide* don't close the Table (branch-2) - #289

Merged
petersomogyi merged 2 commits into
apache:branch-2from
anmolnar:HBASE-13798_b2
Jul 2, 2019
Merged

HBASE-13798 TestFromClientSide* don't close the Table (branch-2)#289
petersomogyi merged 2 commits into
apache:branch-2from
anmolnar:HBASE-13798_b2

Conversation

@anmolnar

Copy link
Copy Markdown
Contributor

This is the branch-2 backport of master patch: 7878389

@anmolnaranmolnar changed the title HBASE-13798 TestFromClientSide* don't close the TableHBASE-13798 TestFromClientSide* don't close the Table (branch-2)Jun 5, 2019
@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec150Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 2 new or modified test files.
_ branch-2 Compile Tests _
+1mvninstall250branch-2 passed
+1compile54branch-2 passed
+1checkstyle73branch-2 passed
+1shadedjars245branch has no errors when building our shaded downstream artifacts.
+1findbugs159branch-2 passed
+1javadoc31branch-2 passed
_ Patch Compile Tests _
+1mvninstall225the patch passed
+1compile51the patch passed
+1javac51the patch passed
-1checkstyle67hbase-server: The patch generated 13 new + 53 unchanged - 68 fixed = 66 total (was 121)
+1whitespace0The patch has no whitespace issues.
+1shadedjars236patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck739Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1findbugs171the patch passed
+1javadoc31the patch passed
_ Other Tests _
-1unit13956hbase-server in the patch failed.
+1asflicense23The patch does not generate ASF License warnings.
16790
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/1/artifact/out/Dockerfile
GITHUB PR#289
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux d1da0ef7d941 4.4.0-137-generic #163-Ubuntu SMP Mon Sep 24 13:14:43 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2 / 3139db5
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/1/artifact/out/diff-checkstyle-hbase-server.txt
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/1/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/1/testReport/
Max. process+thread count4599 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/1/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@saintstack

Copy link
Copy Markdown
Contributor

Nice cleanup @anmolnar Mind force pushing to retrigger build checks? Seems like that is how folks are doing PR re-check (asking...). The patch failed unrelated tests in hbase-server.... which must be unrelated given this just a test refactor. Thanks.

@petersomogyi

Copy link
Copy Markdown
Contributor

I started a new build now.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec31Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 2 new or modified test files.
_ branch-2 Compile Tests _
+1mvninstall241branch-2 passed
+1compile57branch-2 passed
+1checkstyle72branch-2 passed
+1shadedjars240branch has no errors when building our shaded downstream artifacts.
+1findbugs174branch-2 passed
+1javadoc34branch-2 passed
_ Patch Compile Tests _
+1mvninstall228the patch passed
+1compile52the patch passed
+1javac52the patch passed
-1checkstyle67hbase-server: The patch generated 13 new + 53 unchanged - 68 fixed = 66 total (was 121)
+1whitespace0The patch has no whitespace issues.
+1shadedjars245patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck711Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1findbugs177the patch passed
+1javadoc33the patch passed
_ Other Tests _
+1unit7578hbase-server in the patch passed.
+1asflicense30The patch does not generate ASF License warnings.
10283
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/2/artifact/out/Dockerfile
GITHUB PR#289
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 92bfd9960964 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2 / 8328d24
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/2/artifact/out/diff-checkstyle-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/2/testReport/
Max. process+thread count4108 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/2/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@saintstack

Copy link
Copy Markdown
Contributor

Thanks @petersomogyi That worked. Let me try redoing the checks..... So I can document it and know what I'm talking about.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec30Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 2 new or modified test files.
_ branch-2 Compile Tests _
+1mvninstall228branch-2 passed
+1compile52branch-2 passed
+1checkstyle69branch-2 passed
+1shadedjars238branch has no errors when building our shaded downstream artifacts.
+1findbugs160branch-2 passed
+1javadoc33branch-2 passed
_ Patch Compile Tests _
+1mvninstall233the patch passed
+1compile51the patch passed
+1javac51the patch passed
-1checkstyle65hbase-server: The patch generated 13 new + 53 unchanged - 68 fixed = 66 total (was 121)
+1whitespace0The patch has no whitespace issues.
+1shadedjars241patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck698Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1findbugs178the patch passed
+1javadoc32the patch passed
_ Other Tests _
-1unit7828hbase-server in the patch failed.
+1asflicense32The patch does not generate ASF License warnings.
10474
ReasonTests
Failed junit testshadoop.hbase.procedure.TestProcedureManager
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/3/artifact/out/Dockerfile
GITHUB PR#289
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux ffb55344d8f8 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2 / 8328d24
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/3/artifact/out/diff-checkstyle-hbase-server.txt
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/3/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/3/testReport/
Max. process+thread count4146 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/3/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@petersomogyipetersomogyi left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change looks very good!
I have 2 comments, similar ones can be found in a few other test cases, but I don't think we need to modify those in this change.

long [] ts = {1000, 2000, 3000, 4000, 5000};

Table ht = TEST_UTIL.createTable(tableName, FAMILY, 5);
try (Admin admin = TEST_UTIL.getAdmin()) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Apache9 mentioned on master PR that Admin shouldn't be closed. In this case I'd prefer to keep try-with-resource since that's what we have on master and original version explicitly closed admin.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the TEST_UTIL is not created per test, but is setup once only for all tests, then indeed, closing the Admin made by TEST_UTIL will mess up subsequent attempts at using admin.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@petersomogyi Sorry I missed that TEST_UTIL actually stores and maintains the Admin. It should not be closed from tests, but from your comment I cannot decide whether I change it here or just leave, because it's a backport.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we can have this change like this to be consistent between master and branch-2 and fix the Admin closes in a different ticket since that is required on master as well.

if (ts[j].getTableName().equals(tables[i])) {
found = true;
break;
try (Admin admin = TEST_UTIL.getAdmin()) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same here, however, it wasn't closed previously.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There're also a few places in TestFromClientSide3 which missed the refactoring and not closing the Admin.

@saintstack

Copy link
Copy Markdown
Contributor

If new patch, mind addressing the checkstyle issue @anmolnar ? Thanks.

@saintstack

Copy link
Copy Markdown
Contributor

Checks run #3 shows TestProcedure failing which is not realted to changes in here. Just saying.

@anmolnar

Copy link
Copy Markdown
ContributorAuthor

@saintstack Thanks, I will fix checkstyle issues.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec177Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 2 new or modified test files.
_ branch-2 Compile Tests _
+1mvninstall313branch-2 passed
+1compile66branch-2 passed
+1checkstyle86branch-2 passed
+1shadedjars305branch has no errors when building our shaded downstream artifacts.
+1findbugs227branch-2 passed
+1javadoc40branch-2 passed
_ Patch Compile Tests _
+1mvninstall298the patch passed
+1compile65the patch passed
+1javac65the patch passed
-1checkstyle83hbase-server: The patch generated 13 new + 53 unchanged - 68 fixed = 66 total (was 121)
+1whitespace0The patch has no whitespace issues.
+1shadedjars311patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck912Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1findbugs232the patch passed
+1javadoc40the patch passed
_ Other Tests _
-1unit16852hbase-server in the patch failed.
+1asflicense30The patch does not generate ASF License warnings.
20429
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/4/artifact/out/Dockerfile
GITHUB PR#289
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 848f46cdc993 4.4.0-145-generic #171-Ubuntu SMP Tue Mar 26 12:43:40 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2 / 6978d4a
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/4/artifact/out/diff-checkstyle-hbase-server.txt
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/4/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/4/testReport/
Max. process+thread count4450 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/4/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@busbey

Copy link
Copy Markdown
Contributor

this still active?

@anmolnar

Copy link
Copy Markdown
ContributorAuthor

@busbey Yes. I'm still on holiday, but will come back to this next week.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec101Docker mode activated.
_ Prechecks _
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 2 new or modified test files.
_ branch-2 Compile Tests _
+1mvninstall270branch-2 passed
+1compile58branch-2 passed
+1checkstyle72branch-2 passed
+1shadedjars247branch has no errors when building our shaded downstream artifacts.
+1findbugs172branch-2 passed
+1javadoc30branch-2 passed
_ Patch Compile Tests _
+1mvninstall233the patch passed
+1compile56the patch passed
+1javac56the patch passed
-1checkstyle70hbase-server: The patch generated 5 new + 53 unchanged - 68 fixed = 58 total (was 121)
+1whitespace0The patch has no whitespace issues.
+1shadedjars243patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck737Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1findbugs179the patch passed
+1javadoc34the patch passed
_ Other Tests _
+1unit8135hbase-server in the patch passed.
+1asflicense29The patch does not generate ASF License warnings.
10978
SubsystemReport/Notes
DockerClient=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/5/artifact/out/Dockerfile
GITHUB PR#289
Optional Testsdupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux dfdc19020138 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 GNU/Linux
Build toolmaven
Personality/testptch/patchprocess/precommit/personality/provided.sh
git revisionbranch-2 / e153f58
mavenversion: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java1.8.0_181
findbugsv3.1.11
checkstylehttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/5/artifact/out/diff-checkstyle-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/5/testReport/
Max. process+thread count4443 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-289/5/console
Powered byApache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@anmolnar

Copy link
Copy Markdown
ContributorAuthor

@petersomogyi@busbey Most of checkstyle issues have been addressed, unit tests are green.

@petersomogyi
petersomogyi merged commit 2f8ad5a into apache:branch-2Jul 2, 2019
@anmolnar
anmolnar deleted the HBASE-13798_b2 branch July 2, 2019 12:01
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@anmolnar@Apache-HBase@saintstack@petersomogyi@busbey