Add apache-datafusion provider skelton

[gopidesupavan]

---

Was generative AI tooling used to co-author this PR?

• Yes (please specify the tool below)

---

• Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
• For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
• When adding dependency, check compliance with the ASF 3rd Party License Policy.
• For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

[Copilot]

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

[Srabasti]

Thanks for adding this new provider @gopidesupavan!!
Looks like the static checks are failing since the the new provider apache.datafusion is not listed in path below.
https://github.com/apache/airflow/blob/main/airflow-core/docs/extra-packages-ref.rst

Direct link:
https://github.com/apache/airflow/blob/main/airflow-core/docs/extra-packages-ref.rst#apache-software-extras

Suggest to add this to the relevant reference.

| apache.datafusion | pip install apache-airflow[apache.datafusion] | Apache.datafusion hooks and operators |

[Srabasti]

Link "https://airflow.apache.org/docs/apache-airflow-providers-apache-datafusion/0.1.0" gives 404 Error, as below.

I would be happy to update the link if you permit Sir! Was curious to learn more about this new provider, hence was checking out the links.

[gopidesupavan]

Link "https://airflow.apache.org/docs/apache-airflow-providers-apache-datafusion/0.1.0" gives 404 Error, as below.

I would be happy to update the link if you permit Sir! Was curious to learn more about this new provider, hence was checking out the links.

these will be published part of the release for now not required..

[gopidesupavan]

Link "https://airflow.apache.org/docs/apache-airflow-providers-apache-datafusion/0.1.0" gives 404 Error, as below.

I would be happy to update the link if you permit Sir! Was curious to learn more about this new provider, hence was checking out the links.

yes look at this about https://datafusion.apache.org/python/ functionalities it provides

[github-actions]

uv.lock on main just moved via #72058 ("Fix linux/arm64 CI image build broken by the ibm.db2 provider"), commit 57a0519 and this PR currently conflicts.

Quickest fix:

git fetch upstream main && git rebase upstream/main
rm uv.lock && uv lock
git add uv.lock && git rebase --continue
git push --force-with-lease

Automated nudge — ignore if you're not ready to rebase. This comment is updated in place on future uv.lock bumps.