Skip to content

PHOENIX-4917 Fix ClassCastException when projecting array elements in hash join - #358

Closed
geraldss wants to merge 4 commits into
apache:masterfrom
geraldss:master
Closed

PHOENIX-4917 Fix ClassCastException when projecting array elements in hash join#358
geraldss wants to merge 4 commits into
apache:masterfrom
geraldss:master

Conversation

@geraldss

Copy link
Copy Markdown

cc @twdsilva@JamesRTaylor@joshelser Ready for review. Thanks.

@geraldss

Copy link
Copy Markdown
Author

@twdsilva This pull request now includes a new test using a mini-cluster. Please review, thanks.

@twdsilva

Copy link
Copy Markdown
Contributor

@geraldss
I tried running your test without the fix and it still passes. The compiler optimizes the query to use SKIP-SCAN-JOIN so the hash cache is not sent to the server. The explain plan is
CLIENT PARALLEL 1-WAY FULL SCAN OVER UNSALTED_N000001
SERVER ARRAY ELEMENT PROJECTION
SKIP-SCAN-JOIN TABLE 0
DYNAMIC SERVER FILTER BY UNSALTED_N000001.ID IN ($1.$3)

I will just commit your original PR without the test since it doesn't add anything.
You can file a separate JIRA to fix ProjectArrayElemAfterHashJoinIT to actually test HashJoin.

@stoty

Copy link
Copy Markdown
Contributor

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec5m 32sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
-1 ❌test4tests0m 0sThe patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1 💚mvninstall21m 1smaster passed
+0hbaserecompile32m 23sHBase recompiled.
+1 💚compile1m 4smaster passed
+1 💚checkstyle0m 56smaster passed
+1 💚javadoc0m 53smaster passed
+0 🆗spotbugs3m 5sphoenix-core in master has 972 extant spotbugs warnings.
-0 ⚠️patch3m 14sUsed diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.
_ Patch Compile Tests _
-1 ❌mvninstall0m 30sroot in the patch failed.
+0hbaserecompile15m 25sHBase recompiled.
-1 ❌compile0m 20sphoenix-core in the patch failed.
-1 ❌javac0m 20sphoenix-core in the patch failed.
+1 💚checkstyle0m 55sthe patch passed
-1 ❌whitespace0m 0sThe patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
-1 ❌whitespace0m 0sThe patch 30 line(s) with tabs.
+1 💚javadoc0m 50sthe patch passed
-1 ❌spotbugs0m 18sphoenix-core in the patch failed.
_ Other Tests _
-1 ❌unit0m 19sphoenix-core in the patch failed.
+1 💚asflicense0m 15sThe patch does not generate ASF License warnings.
60m 17s
SubsystemReport/Notes
DockerClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-358/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#358
Optional Testsdupname asflicense javac javadoc unit spotbugs hbaserebuild hbaseanti checkstyle compile
unameLinux 7704385c681c 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev/phoenix-personality.sh
git revisionmaster / bfc4621
Default JavaPrivate Build-1.8.0_242-8u242-b08-0ubuntu3~16.04-b08
mvninstallhttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-358/1/artifact/yetus-general-check/output/patch-mvninstall-root.txt
compilehttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-358/1/artifact/yetus-general-check/output/patch-compile-phoenix-core.txt
javachttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-358/1/artifact/yetus-general-check/output/patch-compile-phoenix-core.txt
whitespacehttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-358/1/artifact/yetus-general-check/output/whitespace-eol.txt
whitespacehttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-358/1/artifact/yetus-general-check/output/whitespace-tabs.txt
spotbugshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-358/1/artifact/yetus-general-check/output/patch-spotbugs-phoenix-core.txt
unithttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-358/1/artifact/yetus-general-check/output/patch-unit-phoenix-core.txt
Test Resultshttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-358/1/testReport/
Max. process+thread count94 (vs. ulimit of 30000)
modulesC: phoenix-core U: phoenix-core
Console outputhttps://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-PreCommit-GitHub-PR/job/PR-358/1/console
versionsgit=2.7.4 maven=3.3.9 spotbugs=4.1.3
Powered byApache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@stoty

stoty commented Aug 1, 2023

Copy link
Copy Markdown
Contributor

Already merged.

@stotystoty closed this Aug 1, 2023
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@geraldss@twdsilva@stoty