[WIP][SPARK-32833][SQL] JDBC V2 Datasource aggregate push down

[baibaichen]

What changes were proposed in this pull request?

This PR refactor #29695, it has some limitations in terms of implementation and abstraction:

1. Don't support count
2. Don't support AVG in case of multiple partitions, and actually the current implementation is wrong even in single partition.
3. Don't know how to extend for supporting more aggregation case, for example, sum(if()).
4. Don’t know how to extend for supporting join push down

see the discussion here, The SPIP PDF could be viewed here.

Why are the changes needed?

for better performance

Does this PR introduce any user-facing change?

No

How was this patch tested?

using tests from #29695

[baibaichen]

cc @huaxingao

[wangyum]

ok to test.

[wangyum]

add to whitelist.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41554/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41554/

[baibaichen]

ok to test.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41568/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/41568/

[SparkQA]

Test build #136977 has finished for PR 32061 at commit 75f8fdc.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
• class JDBCTableCatalog extends TableCatalog with SupportsNamespaces with SupportsSQL with Logging
• abstract sealed class PushQuery extends Logging
• class OldPush (
• case class PushScanQuery(
• case class PushAggregateQuery(
• case class SingleSQLStatement(
• case class SingleCatalystStatement(

[SparkQA]

Test build #136991 has finished for PR 32061 at commit dcc16a1.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43714/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/43714/

[github-actions]

We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
If you'd like to revive this PR, please reopen it and ask a committer to remove the Stale tag!