feat: Support SQL filter clause for aggregate expressions, add SQL dialect support

[yjshen]

Which issue does this PR close?

Closes#5873.
Closes#5608
Closes#2214

Rationale for this change

This pull request introduces support for the FILTER (WHERE) clause in aggregate expressions. This feature enables users to filter the rows that are considered for aggregation, similar to how it is done in popular SQL databases such as PostgreSQL, SQLite, Spark, and Hive.

SELECT
department,
SUM(revenue) AS total_revenue,
SUM(revenue) FILTER (WHERE product_type ='Electronics') AS electronics_revenue,
SUM(revenue) FILTER (WHERE product_type ='Furniture') AS furniture_revenue
FROM
sales_data
GROUP BY
department;

What changes are included in this PR?

1. The physical_plan/aggregate module is where the majority of the work for this project was completed.
2. Additionally, there were changes made to the mechanism that routes the optional filter through the optimizer and execution code path.

Are these changes tested?

New tests were added in group_by.rs to cover various scenarios using the FILTER (WHERE) clause with different situations.

Are there any user-facing changes?

Yes.

1. Users can now use the FILTER (WHERE) clause in aggregate expressions in their SQL queries, providing more flexibility and control over the aggregation. This change is backward compatible, and existing queries without the FILTER (WHERE) clause should continue to work as expected.
2. Users can now choose the SQL dialect to be used by the SQL parser.

[alamb]

I plan to review this PR tomorrow. Thank you @yjshen

[alamb]

Thank you @yjshen -- I think this is looking quite nice 👌

I think prior to merge this PR needs:

1. Some more test cases ( I left comments about which ones)
2. We should reconsider changing the Aggregator trait ( I left comments about why)

Again, thank you very much -- this is very neat.

cc @poonai

[alamb]

cc @andygrove@Dandandan and @jdye64

[jdye64]

@alamb thank you for the heads up. Created an issue to make sure we accommodate for these changes. 316

[yjshen]

Thank you @alamb for the detailed review! I have made the following updates to the PR based on your feedback:

1. The optional filter has been moved from aggregate expressions into AggregateExec.
2. All related tests have been moved into .slt. I added additional tests according to your review comments and tested against PostgreSQL results.
3. Miscellaneous dialect configuration changes were made per your comments. By the way, it would be great if create_dialect_from_str could be moved upstream.

This PR is now ready for further review. Thank you again, @alamb!

[alamb]

Looks great to me @yjshen -- thank you. I will upstream the parsing for dialect names now.

The only other thing I really want to do prior to merging this PR is to verify it doesn't change performance. I don't expect that it will but I want to double check to be sure

[alamb]

👍

[alamb]

cc @tustvold@mustafasrepo@crepererum and @Dandandan who I think are all interested in grouping performance

[yjshen]

I benched aggregate_query_sql.rs and confirmed that this has no noticeable effect on the current benchmarks.

[alamb]

I ran this branch against main using https://github.com/alamb/datafusion-benchmarking and I see no performance difference 👍

┏━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━┓
┃ Query ┃ /home/alamb… ┃ /home/alamb… ┃ Change ┃
┡━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━┩
│ QQuery 1 │ 1700.14ms │ 1674.54ms │ no change │
│ QQuery 2 │ 495.96ms │ 476.32ms │ no change │
│ QQuery 3 │ 566.94ms │ 574.48ms │ no change │
│ QQuery 4 │ 238.05ms │ 233.97ms │ no change │
│ QQuery 5 │ 776.22ms │ 747.68ms │ no change │
│ QQuery 6 │ 429.90ms │ 434.80ms │ no change │
│ QQuery 7 │ 1366.64ms │ 1346.81ms │ no change │
│ QQuery 8 │ 756.20ms │ 758.10ms │ no change │
│ QQuery 9 │ 1244.81ms │ 1243.00ms │ no change │
│ QQuery 10 │ 879.18ms │ 851.17ms │ no change │
│ QQuery 11 │ 412.81ms │ 421.18ms │ no change │
│ QQuery 12 │ 346.56ms │ 340.06ms │ no change │
│ QQuery 13 │ 1390.35ms │ 1373.72ms │ no change │
│ QQuery 14 │ 455.99ms │ 447.49ms │ no change │
│ QQuery 15 │ 462.05ms │ 446.96ms │ no change │
│ QQuery 16 │ 356.55ms │ 350.45ms │ no change │
│ QQuery 17 │ 6630.39ms │ 6682.32ms │ no change │
│ QQuery 18 │ 4040.30ms │ 4029.81ms │ no change │
│ QQuery 19 │ 753.73ms │ 780.20ms │ no change │
│ QQuery 20 │ 1948.00ms │ 1903.14ms │ no change │
│ QQuery 21 │ 1865.89ms │ 1935.56ms │ no change │
│ QQuery 22 │ 211.15ms │ 218.02ms │ no change │
└──────────────┴──────────────┴──────────────┴───────────┘

[alamb]

#6616 -- PR to use upstreamed version of parse_sql_dialect