Skip to content

[SPARK-34711][SQL][TESTS] Exercise code-gen enable/disable code paths for SHJ in join test suites - #31806

Closed
c21 wants to merge 1 commit into
apache:masterfrom
c21:test-minor
Closed

[SPARK-34711][SQL][TESTS] Exercise code-gen enable/disable code paths for SHJ in join test suites#31806
c21 wants to merge 1 commit into
apache:masterfrom
c21:test-minor

Conversation

@c21

@c21c21 commented Mar 11, 2021

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Per comment in #31802 (comment) , we would like to exercise whole stage code-gen enabled and disabled code paths in join unit test suites. This is for better test coverage of shuffled hash join.

Why are the changes needed?

Better test coverage.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Existing and added unit tests here.

@c21

c21 commented Mar 11, 2021

Copy link
Copy Markdown
ContributorAuthor

cc @dongjoon-hyun could you help take a look when you have time, thanks.

@dongjoon-hyundongjoon-hyun left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you, @c21 .
+1, LGTM. (Pending CIs)

@dongjoon-hyundongjoon-hyun changed the title [SPARK-34711][SQL] Exercise code-gen enable/disable code paths for SHJ in join test suites[SPARK-34711][SQL][TESTS] Exercise code-gen enable/disable code paths for SHJ in join test suitesMar 11, 2021
@dongjoon-hyun

Copy link
Copy Markdown
Member

This is a test PR and I verified this manually. Merged to master/3.1.

dongjoon-hyun pushed a commit that referenced this pull request Mar 11, 2021
… for SHJ in join test suites
### What changes were proposed in this pull request?
Per comment in #31802 (comment) , we would like to exercise whole stage code-gen enabled and disabled code paths in join unit test suites. This is for better test coverage of shuffled hash join.
### Why are the changes needed?
Better test coverage.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Existing and added unit tests here.
Closes#31806 from c21/test-minor.
Authored-by: Cheng Su <chengsu@fb.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
(cherry picked from commit 9aa8f06)
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
@AmplabJenkins

Copy link
Copy Markdown

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/135963/

@AmplabJenkins

Copy link
Copy Markdown

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/40547/

@c21

c21 commented Mar 11, 2021

Copy link
Copy Markdown
ContributorAuthor

Thank you @dongjoon-hyun for review!

@c21
c21 deleted the test-minor branch March 11, 2021 08:50
flyrain pushed a commit to flyrain/spark that referenced this pull request Sep 21, 2021
… for SHJ in join test suites
### What changes were proposed in this pull request?
Per comment in apache#31802 (comment) , we would like to exercise whole stage code-gen enabled and disabled code paths in join unit test suites. This is for better test coverage of shuffled hash join.
### Why are the changes needed?
Better test coverage.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Existing and added unit tests here.
Closesapache#31806 from c21/test-minor.
Authored-by: Cheng Su <chengsu@fb.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
(cherry picked from commit 9aa8f06)
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@c21@dongjoon-hyun@AmplabJenkins