Skip to content

PHOENIX-5296 : Ensure store file reader refcount is zero at end of relevant unit tests - #1097

Closed
virajjasani wants to merge 1 commit into
apache:4.xfrom
virajjasani:PHOENIX-5296-4.x
Closed

PHOENIX-5296 : Ensure store file reader refcount is zero at end of relevant unit tests#1097
virajjasani wants to merge 1 commit into
apache:4.xfrom
virajjasani:PHOENIX-5296-4.x

Conversation

@virajjasani

@virajjasanivirajjasani commented Jan 18, 2021

Copy link
Copy Markdown
Contributor

4.x backport PR of #1096

@stoty

Copy link
Copy Markdown
Contributor

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 8sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ 4.x Compile Tests _
+0 🆗mvndep5m 26sMaven dependency ordering for branch
+1 💚mvninstall10m 55s4.x passed
+1 💚compile1m 41s4.x passed
+1 💚checkstyle0m 33s4.x passed
+1 💚javadoc1m 25s4.x passed
+0 🆗spotbugs0m 29sphoenix-hbase-compat-1.5.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 24sphoenix-hbase-compat-1.4.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 24sphoenix-hbase-compat-1.3.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs3m 15sphoenix-core in 4.x has 945 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗mvndep0m 11sMaven dependency ordering for patch
+1 💚mvninstall7m 1sthe patch passed
+1 💚compile1m 42sthe patch passed
+1 💚javac1m 42sthe patch passed
-1 ❌checkstyle0m 34sroot: The patch generated 10 new + 12 unchanged - 0 fixed = 22 total (was 12)
-1 ❌whitespace0m 0sThe patch 31 line(s) with tabs.
+1 💚javadoc1m 24sthe patch passed
+1 💚spotbugs5m 19sthe patch passed
_ Other Tests _
-1 ❌unit178m 41sroot in the patch failed.
+1 💚asflicense2m 5sThe patch does not generate ASF License warnings.
226m 17s
ReasonTests
Failed junit testsphoenix.end2end.SystemTablesCreationOnConnectionIT
phoenix.tx.TxCheckpointIT
phoenix.end2end.OrphanViewToolIT
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#1097
Optional Testsdupname asflicense javac javadoc unit spotbugs hbaseanti checkstyle compile
unameLinux 2bd20ca36f53 4.15.0-126-generic #129-Ubuntu SMP Mon Nov 23 18:53:38 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev/phoenix-personality.sh
git revision4.x / 6fe6052
Default JavaPrivate Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08
checkstylehttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/1/artifact/yetus-general-check/output/diff-checkstyle-root.txt
whitespacehttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/1/artifact/yetus-general-check/output/whitespace-tabs.txt
unithttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/1/artifact/yetus-general-check/output/patch-unit-root.txt
Test Resultshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/1/testReport/
Max. process+thread count5470 (vs. ulimit of 30000)
modulesC: phoenix-hbase-compat-1.5.0 phoenix-hbase-compat-1.4.0 phoenix-hbase-compat-1.3.0 phoenix-core U: .
Console outputhttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/1/console
versionsgit=2.7.4 maven=3.3.9 spotbugs=4.1.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@virajjasani

Copy link
Copy Markdown
ContributorAuthor

Once changes are finalized in #1096 , will get them here together.

@stotystoty left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you port the latest version from master here ?

@virajjasani

Copy link
Copy Markdown
ContributorAuthor

Sure, I am on it.

@stoty

Copy link
Copy Markdown
Contributor

Looks good, let's wait for the Yetus checks.

@virajjasani

Copy link
Copy Markdown
ContributorAuthor

Build#2 is aborted, let's see how build#3 goes, it was lined up.

@stoty

Copy link
Copy Markdown
Contributor

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 33sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ 4.x Compile Tests _
+0 🆗mvndep5m 0sMaven dependency ordering for branch
+1 💚mvninstall10m 0s4.x passed
+1 💚compile1m 33s4.x passed
+1 💚checkstyle0m 34s4.x passed
+1 💚javadoc1m 27s4.x passed
+0 🆗spotbugs0m 30sphoenix-hbase-compat-1.5.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 26sphoenix-hbase-compat-1.4.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 25sphoenix-hbase-compat-1.3.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs2m 55sphoenix-core in 4.x has 945 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗mvndep0m 12sMaven dependency ordering for patch
+1 💚mvninstall5m 53sthe patch passed
+1 💚compile1m 34sthe patch passed
+1 💚javac1m 34sthe patch passed
-1 ❌checkstyle0m 32sroot: The patch generated 10 new + 36 unchanged - 0 fixed = 46 total (was 36)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚xml0m 1sThe patch has no ill-formed XML file.
+1 💚javadoc1m 24sthe patch passed
+1 💚spotbugs5m 6sthe patch passed
_ Other Tests _
-1 ❌unit133m 51sroot in the patch failed.
+1 💚asflicense2m 33sThe patch does not generate ASF License warnings.
178m 28s
ReasonTests
Failed junit testsphoenix.end2end.SystemTablesCreationOnConnectionIT
phoenix.end2end.salted.SaltedTableUpsertSelectIT
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/7/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#1097
Optional Testsdupname asflicense javac javadoc unit spotbugs hbaseanti checkstyle compile xml
unameLinux 6438e13c5354 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev/phoenix-personality.sh
git revision4.x / 14e69c3
Default JavaPrivate Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08
checkstylehttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/7/artifact/yetus-general-check/output/diff-checkstyle-root.txt
unithttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/7/artifact/yetus-general-check/output/patch-unit-root.txt
Test Resultshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/7/testReport/
Max. process+thread count5923 (vs. ulimit of 30000)
modulesC: phoenix-hbase-compat-1.5.0 phoenix-hbase-compat-1.4.0 phoenix-hbase-compat-1.3.0 phoenix-core U: .
Console outputhttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/7/console
versionsgit=2.7.4 maven=3.3.9 spotbugs=4.1.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@virajjasani

virajjasani commented Jan 20, 2021

Copy link
Copy Markdown
ContributorAuthor

@stoty For 4.x, a couple more patch results are available on Jira. But master patch builds are still taking time. What do you suggest? Let's see some builds are anyways in progress.

@stoty

Copy link
Copy Markdown
Contributor

Can you start one more for each branch ?
I'll probably merge it tomorrow morning-

@virajjasani

virajjasani commented Jan 21, 2021

Copy link
Copy Markdown
ContributorAuthor

PR-1097#8 build timed out after 9 hr and PR-1097#9 is in progress. In the meanwhile, we have below build results available from precommit Jira for 4.x (QA results available on Jira):

https://ci-hadoop.apache.org/job/PreCommit-PHOENIX-Build/367/
https://ci-hadoop.apache.org/job/PreCommit-PHOENIX-Build/368/
https://ci-hadoop.apache.org/job/PreCommit-PHOENIX-Build/369/
https://ci-hadoop.apache.org/job/PreCommit-PHOENIX-Build/370/

For PR-1096, both latest triggered builds were successful.

While precommit PR builds are serial, precommit Jira builds can run in parallel (consuming more resources?)

@stoty

Copy link
Copy Markdown
Contributor

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec2m 34sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 1sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ 4.x Compile Tests _
+0 🆗mvndep5m 26sMaven dependency ordering for branch
+1 💚mvninstall12m 54s4.x passed
+1 💚compile1m 44s4.x passed
+1 💚checkstyle0m 34s4.x passed
+1 💚javadoc1m 26s4.x passed
+0 🆗spotbugs0m 28sphoenix-hbase-compat-1.5.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 26sphoenix-hbase-compat-1.4.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 25sphoenix-hbase-compat-1.3.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs3m 12sphoenix-core in 4.x has 945 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗mvndep0m 11sMaven dependency ordering for patch
+1 💚mvninstall7m 9sthe patch passed
+1 💚compile1m 41sthe patch passed
+1 💚javac1m 41sthe patch passed
-1 ❌checkstyle0m 35sroot: The patch generated 10 new + 36 unchanged - 0 fixed = 46 total (was 36)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚xml0m 2sThe patch has no ill-formed XML file.
+1 💚javadoc1m 25sthe patch passed
+1 💚spotbugs5m 22sthe patch passed
_ Other Tests _
-1 ❌unit196m 15sroot in the patch failed.
+1 💚asflicense2m 3sThe patch does not generate ASF License warnings.
247m 38s
ReasonTests
Failed junit testsphoenix.end2end.OrphanViewToolIT
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/11/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#1097
Optional Testsdupname asflicense javac javadoc unit spotbugs hbaseanti checkstyle compile xml
unameLinux d5ba4f42526d 4.15.0-126-generic #129-Ubuntu SMP Mon Nov 23 18:53:38 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev/phoenix-personality.sh
git revision4.x / 14e69c3
Default JavaPrivate Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08
checkstylehttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/11/artifact/yetus-general-check/output/diff-checkstyle-root.txt
unithttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/11/artifact/yetus-general-check/output/patch-unit-root.txt
Test Resultshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/11/testReport/
Max. process+thread count4691 (vs. ulimit of 30000)
modulesC: phoenix-hbase-compat-1.5.0 phoenix-hbase-compat-1.4.0 phoenix-hbase-compat-1.3.0 phoenix-core U: .
Console outputhttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/11/console
versionsgit=2.7.4 maven=3.3.9 spotbugs=4.1.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@stoty

Copy link
Copy Markdown
Contributor

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 32sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 1sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ 4.x Compile Tests _
+0 🆗mvndep5m 3sMaven dependency ordering for branch
+1 💚mvninstall11m 49s4.x passed
+1 💚compile1m 54s4.x passed
+1 💚checkstyle0m 39s4.x passed
+1 💚javadoc1m 43s4.x passed
+0 🆗spotbugs0m 32sphoenix-hbase-compat-1.5.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 30sphoenix-hbase-compat-1.4.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 27sphoenix-hbase-compat-1.3.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs3m 37sphoenix-core in 4.x has 945 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗mvndep0m 13sMaven dependency ordering for patch
+1 💚mvninstall7m 14sthe patch passed
+1 💚compile1m 52sthe patch passed
+1 💚javac1m 52sthe patch passed
-1 ❌checkstyle0m 40sroot: The patch generated 10 new + 36 unchanged - 0 fixed = 46 total (was 36)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚xml0m 2sThe patch has no ill-formed XML file.
+1 💚javadoc1m 39sthe patch passed
+1 💚spotbugs6m 21sthe patch passed
_ Other Tests _
-1 ❌unit192m 30sroot in the patch failed.
+1 💚asflicense2m 7sThe patch does not generate ASF License warnings.
244m 16s
ReasonTests
Failed junit testsphoenix.end2end.IndexScrutinyToolIT
phoenix.end2end.AlterTableIT
phoenix.end2end.OrphanViewToolIT
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/12/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#1097
Optional Testsdupname asflicense javac javadoc unit spotbugs hbaseanti checkstyle compile xml
unameLinux bb0bc265377b 4.15.0-126-generic #129-Ubuntu SMP Mon Nov 23 18:53:38 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev/phoenix-personality.sh
git revision4.x / d33f782
Default JavaPrivate Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08
checkstylehttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/12/artifact/yetus-general-check/output/diff-checkstyle-root.txt
unithttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/12/artifact/yetus-general-check/output/patch-unit-root.txt
Test Resultshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/12/testReport/
Max. process+thread count5130 (vs. ulimit of 30000)
modulesC: phoenix-hbase-compat-1.5.0 phoenix-hbase-compat-1.4.0 phoenix-hbase-compat-1.3.0 phoenix-core U: .
Console outputhttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/12/console
versionsgit=2.7.4 maven=3.3.9 spotbugs=4.1.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@virajjasani

Copy link
Copy Markdown
ContributorAuthor

Just removed changes in OrphanViewToolIT from refCount check for now. Will try to add it later as separate Jira.

@stoty

Copy link
Copy Markdown
Contributor

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 33sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ 4.x Compile Tests _
+0 🆗mvndep4m 58sMaven dependency ordering for branch
+1 💚mvninstall9m 58s4.x passed
+1 💚compile1m 34s4.x passed
+1 💚checkstyle0m 34s4.x passed
+1 💚javadoc1m 25s4.x passed
+0 🆗spotbugs0m 29sphoenix-hbase-compat-1.5.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 25sphoenix-hbase-compat-1.4.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 24sphoenix-hbase-compat-1.3.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs2m 57sphoenix-core in 4.x has 945 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗mvndep0m 12sMaven dependency ordering for patch
+1 💚mvninstall6m 25sthe patch passed
+1 💚compile1m 35sthe patch passed
+1 💚javac1m 35sthe patch passed
-1 ❌checkstyle0m 35sroot: The patch generated 14 new + 36 unchanged - 0 fixed = 50 total (was 36)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚xml0m 1sThe patch has no ill-formed XML file.
+1 💚javadoc1m 25sthe patch passed
-1 ❌spotbugs0m 42sphoenix-hbase-compat-1.5.0 generated 1 new + 3 unchanged - 0 fixed = 4 total (was 3)
_ Other Tests _
-1 ❌unit151m 9sroot in the patch failed.
+1 💚asflicense0m 35sThe patch does not generate ASF License warnings.
192m 44s
ReasonTests
FindBugsmodule:phoenix-hbase-compat-1.5.0
org.apache.phoenix.compat.hbase.CompatUtil.isAnyStoreRefCountLeaked(HMaster) calls Thread.sleep() with a lock held At CompatUtil.java:lock held At CompatUtil.java:[line 61]
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/15/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#1097
Optional Testsdupname asflicense javac javadoc unit spotbugs hbaseanti checkstyle compile xml
unameLinux a7764916236d 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev/phoenix-personality.sh
git revision4.x / a175cc0
Default JavaPrivate Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08
checkstylehttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/15/artifact/yetus-general-check/output/diff-checkstyle-root.txt
spotbugshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/15/artifact/yetus-general-check/output/new-spotbugs-phoenix-hbase-compat-1.5.0.html
unithttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/15/artifact/yetus-general-check/output/patch-unit-root.txt
Test Resultshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/15/testReport/
Max. process+thread count5683 (vs. ulimit of 30000)
modulesC: phoenix-hbase-compat-1.5.0 phoenix-hbase-compat-1.4.0 phoenix-hbase-compat-1.3.0 phoenix-core U: .
Console outputhttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/15/console
versionsgit=2.7.4 maven=3.3.9 spotbugs=4.1.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@stoty

Copy link
Copy Markdown
Contributor

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 53sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ 4.x Compile Tests _
+0 🆗mvndep5m 4sMaven dependency ordering for branch
+1 💚mvninstall12m 10s4.x passed
+1 💚compile1m 40s4.x passed
+1 💚checkstyle0m 35s4.x passed
+1 💚javadoc1m 23s4.x passed
+0 🆗spotbugs0m 30sphoenix-hbase-compat-1.5.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 25sphoenix-hbase-compat-1.4.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 25sphoenix-hbase-compat-1.3.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs2m 56sphoenix-core in 4.x has 945 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗mvndep0m 13sMaven dependency ordering for patch
+1 💚mvninstall5m 46sthe patch passed
+1 💚compile1m 31sthe patch passed
+1 💚javac1m 31sthe patch passed
-1 ❌checkstyle0m 34sroot: The patch generated 14 new + 36 unchanged - 0 fixed = 50 total (was 36)
+1 💚whitespace0m 1sThe patch has no whitespace issues.
+1 💚xml0m 1sThe patch has no ill-formed XML file.
+1 💚javadoc1m 24sthe patch passed
-1 ❌spotbugs0m 41sphoenix-hbase-compat-1.5.0 generated 1 new + 3 unchanged - 0 fixed = 4 total (was 3)
_ Other Tests _
-1 ❌unit200m 39sroot in the patch failed.
+1 💚asflicense2m 56sThe patch does not generate ASF License warnings.
249m 17s
ReasonTests
FindBugsmodule:phoenix-hbase-compat-1.5.0
org.apache.phoenix.compat.hbase.CompatUtil.isAnyStoreRefCountLeaked(HMaster) calls Thread.sleep() with a lock held At CompatUtil.java:lock held At CompatUtil.java:[line 61]
Failed junit testsphoenix.end2end.index.IndexMetadataIT
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/16/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#1097
Optional Testsdupname asflicense javac javadoc unit spotbugs hbaseanti checkstyle compile xml
unameLinux 928f3c781126 4.15.0-65-generic #74-Ubuntu SMP Tue Sep 17 17:06:04 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev/phoenix-personality.sh
git revision4.x / a175cc0
Default JavaPrivate Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08
checkstylehttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/16/artifact/yetus-general-check/output/diff-checkstyle-root.txt
spotbugshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/16/artifact/yetus-general-check/output/new-spotbugs-phoenix-hbase-compat-1.5.0.html
unithttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/16/artifact/yetus-general-check/output/patch-unit-root.txt
Test Resultshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/16/testReport/
Max. process+thread count4807 (vs. ulimit of 30000)
modulesC: phoenix-hbase-compat-1.5.0 phoenix-hbase-compat-1.4.0 phoenix-hbase-compat-1.3.0 phoenix-core U: .
Console outputhttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/16/console
versionsgit=2.7.4 maven=3.3.9 spotbugs=4.1.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@stoty

Copy link
Copy Markdown
Contributor

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 35sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 1sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ 4.x Compile Tests _
+0 🆗mvndep5m 8sMaven dependency ordering for branch
+1 💚mvninstall9m 54s4.x passed
+1 💚compile1m 33s4.x passed
+1 💚checkstyle0m 33s4.x passed
+1 💚javadoc1m 27s4.x passed
+0 🆗spotbugs0m 29sphoenix-hbase-compat-1.5.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 27sphoenix-hbase-compat-1.4.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 24sphoenix-hbase-compat-1.3.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs2m 55sphoenix-core in 4.x has 945 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗mvndep0m 12sMaven dependency ordering for patch
+1 💚mvninstall5m 59sthe patch passed
+1 💚compile1m 33sthe patch passed
+1 💚javac1m 33sthe patch passed
-1 ❌checkstyle0m 33sroot: The patch generated 14 new + 36 unchanged - 0 fixed = 50 total (was 36)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚xml0m 1sThe patch has no ill-formed XML file.
+1 💚javadoc1m 22sthe patch passed
-1 ❌spotbugs0m 41sphoenix-hbase-compat-1.5.0 generated 1 new + 3 unchanged - 0 fixed = 4 total (was 3)
_ Other Tests _
-1 ❌unit140m 17sroot in the patch failed.
+1 💚asflicense0m 35sThe patch does not generate ASF License warnings.
181m 9s
ReasonTests
FindBugsmodule:phoenix-hbase-compat-1.5.0
org.apache.phoenix.compat.hbase.CompatUtil.isAnyStoreRefCountLeaked(HMaster) calls Thread.sleep() with a lock held At CompatUtil.java:lock held At CompatUtil.java:[line 61]
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/18/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#1097
Optional Testsdupname asflicense javac javadoc unit spotbugs hbaseanti checkstyle compile xml
unameLinux d6b4ce08ea2c 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev/phoenix-personality.sh
git revision4.x / 88f4362
Default JavaPrivate Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08
checkstylehttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/18/artifact/yetus-general-check/output/diff-checkstyle-root.txt
spotbugshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/18/artifact/yetus-general-check/output/new-spotbugs-phoenix-hbase-compat-1.5.0.html
unithttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/18/artifact/yetus-general-check/output/patch-unit-root.txt
Test Resultshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/18/testReport/
Max. process+thread count5766 (vs. ulimit of 30000)
modulesC: phoenix-hbase-compat-1.5.0 phoenix-hbase-compat-1.4.0 phoenix-hbase-compat-1.3.0 phoenix-core U: .
Console outputhttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/18/console
versionsgit=2.7.4 maven=3.3.9 spotbugs=4.1.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@stotystoty left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, apart form the indent nits. see
https://www.oracle.com/technetwork/java/codeconventions-150003.pdf section 4.2

{1L, 20L, 10L, 1L, 1L},
{1L, 20L, 10L, 0L, 2L},
{1L, 100L, 10L, 0L, 3L},
{100000L, 5000L, 10L, 0L, 0L},

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Your autoformatter doesn't seem to be set up right.
Continuation lines should either be matched to the previous expression, or use 8 spaces, not 4.

StringBuilder ddl = new StringBuilder("CREATE TABLE " + fullTableName
+ " (col1 varchar primary key");
for (int i = 2; i< columns; i++){
+ " (col1 varchar primary key");

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

indent 8 here too

private static final String MODIFIED_MAX_VERSIONS ="5";
private static final String CREATE_TABLE_STMT = "CREATE TABLE %s"
+ " (k1 VARCHAR NOT NULL, k2 VARCHAR, CONSTRAINT PK PRIMARY KEY(K1,K2))";
+ " (k1 VARCHAR NOT NULL, k2 VARCHAR, CONSTRAINT PK PRIMARY KEY(K1,K2))";

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These line continuations do match the conventions in https://phoenix.apache.org/contributing.html .
I know that we have code in much worse shape than this, but since you are fixing formatting, we might as well do it by the book.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

True, i just realized that i had continuation tab as 4 as opposed to 8.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you meant do not match the conventions above right?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

https://phoenix.apache.org/develop.html details the steps for Eclipse and intelliJ

@stoty

Copy link
Copy Markdown
Contributor

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 9sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ 4.x Compile Tests _
+0 🆗mvndep5m 1sMaven dependency ordering for branch
+1 💚mvninstall10m 49s4.x passed
+1 💚compile1m 39s4.x passed
+1 💚checkstyle0m 36s4.x passed
+1 💚javadoc1m 25s4.x passed
+0 🆗spotbugs0m 29sphoenix-hbase-compat-1.5.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 25sphoenix-hbase-compat-1.4.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 24sphoenix-hbase-compat-1.3.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs3m 15sphoenix-core in 4.x has 945 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗mvndep0m 12sMaven dependency ordering for patch
+1 💚mvninstall6m 52sthe patch passed
+1 💚compile1m 39sthe patch passed
+1 💚javac1m 39sthe patch passed
-1 ❌checkstyle0m 33sroot: The patch generated 14 new + 36 unchanged - 0 fixed = 50 total (was 36)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚xml0m 2sThe patch has no ill-formed XML file.
+1 💚javadoc1m 25sthe patch passed
-1 ❌spotbugs0m 40sphoenix-hbase-compat-1.5.0 generated 1 new + 3 unchanged - 0 fixed = 4 total (was 3)
_ Other Tests _
-1 ❌unit200m 18sroot in the patch failed.
+1 💚asflicense0m 32sThe patch does not generate ASF License warnings.
244m 2s
ReasonTests
FindBugsmodule:phoenix-hbase-compat-1.5.0
org.apache.phoenix.compat.hbase.CompatUtil.isAnyStoreRefCountLeaked(HMaster) calls Thread.sleep() with a lock held At CompatUtil.java:lock held At CompatUtil.java:[line 61]
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/20/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#1097
Optional Testsdupname asflicense javac javadoc unit spotbugs hbaseanti checkstyle compile xml
unameLinux 7d82776da927 4.15.0-126-generic #129-Ubuntu SMP Mon Nov 23 18:53:38 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev/phoenix-personality.sh
git revision4.x / 51715b3
Default JavaPrivate Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08
checkstylehttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/20/artifact/yetus-general-check/output/diff-checkstyle-root.txt
spotbugshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/20/artifact/yetus-general-check/output/new-spotbugs-phoenix-hbase-compat-1.5.0.html
unithttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/20/artifact/yetus-general-check/output/patch-unit-root.txt
Test Resultshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/20/testReport/
Max. process+thread count4667 (vs. ulimit of 30000)
modulesC: phoenix-hbase-compat-1.5.0 phoenix-hbase-compat-1.4.0 phoenix-hbase-compat-1.3.0 phoenix-core U: .
Console outputhttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/20/console
versionsgit=2.7.4 maven=3.3.9 spotbugs=4.1.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@virajjasanivirajjasani changed the title PHOENIX-5296 : refCount leak checksPHOENIX-5296 : Ensure store file reader refcount is zero at end of relevant unit testsJan 26, 2021
@stoty

Copy link
Copy Markdown
Contributor

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 5sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ 4.x Compile Tests _
+0 🆗mvndep5m 2sMaven dependency ordering for branch
+1 💚mvninstall10m 56s4.x passed
+1 💚compile1m 39s4.x passed
+1 💚checkstyle0m 35s4.x passed
+1 💚javadoc1m 25s4.x passed
+0 🆗spotbugs0m 29sphoenix-hbase-compat-1.5.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 25sphoenix-hbase-compat-1.4.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs0m 25sphoenix-hbase-compat-1.3.0 in 4.x has 3 extant spotbugs warnings.
+0 🆗spotbugs3m 14sphoenix-core in 4.x has 945 extant spotbugs warnings.
_ Patch Compile Tests _
+0 🆗mvndep0m 12sMaven dependency ordering for patch
+1 💚mvninstall6m 52sthe patch passed
+1 💚compile1m 39sthe patch passed
+1 💚javac1m 39sthe patch passed
-1 ❌checkstyle0m 33sroot: The patch generated 14 new + 36 unchanged - 0 fixed = 50 total (was 36)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚xml0m 1sThe patch has no ill-formed XML file.
+1 💚javadoc1m 25sthe patch passed
-1 ❌spotbugs0m 40sphoenix-hbase-compat-1.5.0 generated 1 new + 3 unchanged - 0 fixed = 4 total (was 3)
_ Other Tests _
-1 ❌unit196m 6sroot in the patch failed.
+1 💚asflicense0m 33sThe patch does not generate ASF License warnings.
239m 55s
ReasonTests
FindBugsmodule:phoenix-hbase-compat-1.5.0
org.apache.phoenix.compat.hbase.CompatUtil.isAnyStoreRefCountLeaked(HMaster) calls Thread.sleep() with a lock held At CompatUtil.java:lock held At CompatUtil.java:[line 61]
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/21/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#1097
Optional Testsdupname asflicense javac javadoc unit spotbugs hbaseanti checkstyle compile xml
unameLinux 3997859181e6 4.15.0-126-generic #129-Ubuntu SMP Mon Nov 23 18:53:38 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev/phoenix-personality.sh
git revision4.x / 51715b3
Default JavaPrivate Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08
checkstylehttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/21/artifact/yetus-general-check/output/diff-checkstyle-root.txt
spotbugshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/21/artifact/yetus-general-check/output/new-spotbugs-phoenix-hbase-compat-1.5.0.html
unithttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/21/artifact/yetus-general-check/output/patch-unit-root.txt
Test Resultshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/21/testReport/
Max. process+thread count4888 (vs. ulimit of 30000)
modulesC: phoenix-hbase-compat-1.5.0 phoenix-hbase-compat-1.4.0 phoenix-hbase-compat-1.3.0 phoenix-core U: .
Console outputhttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-1097/21/console
versionsgit=2.7.4 maven=3.3.9 spotbugs=4.1.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@stoty

Copy link
Copy Markdown
Contributor

Comitted with updated commit message.

@stotystoty closed this Jan 27, 2021
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@virajjasani@stoty