Uh oh!
There was an error while loading. Please reload this page.
[SPARK-21787][SQL] Support for pushing down filters for DateType in native OrcFileFormat - #18995
[SPARK-21787][SQL] Support for pushing down filters for DateType in native OrcFileFormat#18995dongjoon-hyun wants to merge 1 commit into
Conversation
dongjoon-hyun
commented
Aug 18, 2017
Hi, @cloud-fan, @gatorsmile, @rxin , @sameeragarwal . |
SparkQA
commented
Aug 18, 2017
Test build #80854 has finished for PR 18995 at commit
|
SparkQA
commented
Aug 18, 2017
Test build #80857 has finished for PR 18995 at commit
|
dongjoon-hyun
commented
Nov 10, 2017
This will be supported in a new ORCFileFormat after merging #18953. |
SparkQA
commented
Nov 10, 2017
Test build #83700 has finished for PR 18995 at commit
|
There was a problem hiding this comment.
Please note that this suite use Apache ORC SearchArgument and PredicateLeaf classes.
We cannot share the test code for this suite.
There was a problem hiding this comment.
By using full canonical class names, we will explicitly test new OrcFileFormat in sql/core and old OrcFileFormat in sql/hive without considering SQL ORC switching conf.
dongjoon-hyun
commented
Dec 3, 2017
Hi, @cloud-fan . |
SparkQA
commented
Dec 4, 2017
Test build #84405 has finished for PR 18995 at commit
|
cloud-fan
commented
Dec 4, 2017
maybe have a PR to move the tests first? |
dongjoon-hyun
commented
Dec 4, 2017
For the other part, I'm restructuring to remove redundancy in the same manner of This one cannot be the part of that restructuring, because the test function signatures are different due to Could you review this first? |
BTW, @cloud-fan . Do you mean literally Otherwise, I had a set of ported duplicated test suites in the previous PRs. Is it okay? |
SparkQA
commented
Dec 7, 2017
Test build #84609 has finished for PR 18995 at commit
|
dongjoon-hyun
commented
Dec 7, 2017
Hi, @cloud-fan . |
cloud-fan
commented
Dec 8, 2017
thanks, merging to master! |
dongjoon-hyun
commented
Dec 8, 2017
Thank you so much, @cloud-fan ! |
What changes were proposed in this pull request?
This PR support for pushing down filters for DateType in ORC
How was this patch tested?
Pass the Jenkins with newly add and updated test cases.