Skip to content

[SPARK-28334][SQL][TEST] Port select.sql - #25096

Closed
wangyum wants to merge 6 commits into
apache:masterfrom
wangyum:SPARK-28334
Closed

[SPARK-28334][SQL][TEST] Port select.sql#25096
wangyum wants to merge 6 commits into
apache:masterfrom
wangyum:SPARK-28334

Conversation

@wangyum

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This PR is to port select.sql from PostgreSQL regression tests. https://github.com/postgres/postgres/blob/REL_12_BETA2/src/test/regress/sql/select.sql

The expected results can be found in the link: https://github.com/postgres/postgres/blob/REL_12_BETA2/src/test/regress/expected/select.out

When porting the test cases, found four PostgreSQL specific features that do not exist in Spark SQL:
SPARK-28010: Support ORDER BY ... USING syntax
SPARK-28329: Support SELECT INTO syntax
SPARK-28330: Enhance query limit
SPARK-28296: Improved VALUES support

Also, found one inconsistent behavior:
SPARK-28333: NULLS FIRST for DESC and NULLS LAST for ASC

How was this patch tested?

N/A

@SparkQA

Copy link
Copy Markdown

Test build #107455 has finished for PR 25096 at commit 767c677.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Comment threadsql/core/src/test/scala/org/apache/spark/sql/SQLQueryTestSuite.scala Outdated
@SparkQA

Copy link
Copy Markdown

Test build #107466 has finished for PR 25096 at commit c655e58.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun

Copy link
Copy Markdown
Member

Hi, @maropu .
Could you review this please, too?

@SparkQA

Copy link
Copy Markdown

Test build #107491 has finished for PR 25096 at commit 7aa7d49.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@maropu

maropu commented Jul 11, 2019

Copy link
Copy Markdown
Member

I left one comment though, it looks ok to me.

@SparkQA

Copy link
Copy Markdown

Test build #107532 has finished for PR 25096 at commit 092bba9.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyundongjoon-hyun left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. Thank you so much, @wangyum and @maropu !
Merged to master.

@wangyum
wangyum deleted the SPARK-28334 branch July 11, 2019 23:19
vinodkc pushed a commit to vinodkc/spark that referenced this pull request Jul 18, 2019
## What changes were proposed in this pull request?
This PR is to port select.sql from PostgreSQL regression tests. https://github.com/postgres/postgres/blob/REL_12_BETA2/src/test/regress/sql/select.sql
The expected results can be found in the link: https://github.com/postgres/postgres/blob/REL_12_BETA2/src/test/regress/expected/select.out
When porting the test cases, found four PostgreSQL specific features that do not exist in Spark SQL:
[SPARK-28010](https://issues.apache.org/jira/browse/SPARK-28010): Support ORDER BY ... USING syntax
[SPARK-28329](https://issues.apache.org/jira/browse/SPARK-28329): Support SELECT INTO syntax
[SPARK-28330](https://issues.apache.org/jira/browse/SPARK-28330): Enhance query limit
[SPARK-28296](https://issues.apache.org/jira/browse/SPARK-28296): Improved VALUES support
Also, found one inconsistent behavior:
[SPARK-28333](https://issues.apache.org/jira/browse/SPARK-28333): `NULLS FIRST` for `DESC` and `NULLS LAST` for `ASC`
## How was this patch tested?
N/A
Closesapache#25096 from wangyum/SPARK-28334.
Authored-by: Yuming Wang <yumwang@ebay.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@wangyum@SparkQA@dongjoon-hyun@maropu