[SPARK-13871][SQL] Support for inferring filters from data constraints

[sameeragarwal]

What changes were proposed in this pull request?

This PR generalizes the NullFiltering optimizer rule in catalyst to InferFiltersFromConstraints that can automatically infer all relevant filters based on an operator's constraints while making sure of 2 things:

(a) no redundant filters are generated, and
(b) filters that do not contribute to any further optimizations are not generated.

How was this patch tested?

Extended all tests in InferFiltersFromConstraintsSuite (that were initially based on NullFilteringSuite to test filter inference in Filter and Join operators.

In particular the 2 tests ( single inner join with pre-existing filters: filter out values on either side and multiple inner joins: filter out values on all sides on equi-join keys attempts to highlight/test the real potential of this rule for join optimization.

[sameeragarwal]

cc @nongli@yhuai@gatorsmile

[SparkQA]

Test build #52963 has finished for PR 11665 at commit 308e93c.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[gatorsmile]

Nit: join @ Join

[SparkQA]

Test build #53051 has finished for PR 11665 at commit d7f8d34.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #53101 has finished for PR 11665 at commit 4b0cf5f.

• This patch fails MiMa tests.
• This patch merges cleanly.
• This patch adds no public classes.

[sameeragarwal]

test this please

[SparkQA]

Test build #53104 has finished for PR 11665 at commit 4b0cf5f.

• This patch fails MiMa tests.
• This patch merges cleanly.
• This patch adds no public classes.

[sameeragarwal]

test this please

[SparkQA]

Test build #53113 has finished for PR 11665 at commit 4b0cf5f.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[nongli]

This rule doesn't seem related to the comment above it (same for nullfiltering)

[nongli]

This comment seems like a clearer version of the first sentence in the object comment. I'd remove this here and replace the first sentence of the above comment.

[sameeragarwal]

thanks, all comments addressed!

[SparkQA]

Test build #53330 has finished for PR 11665 at commit 336a18e.

• This patch fails Scala style tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Test build #53331 has finished for PR 11665 at commit 92d935f.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[nongli]

LGTM