openlineage: migrate OpenLineage provider to V2 facets.

[JDarDagran]

In OpenLineage/OpenLineage#2520 released in openlineage-python==1.13.1 there were introduced V2 classes for facets and events.

[JDarDagran]

I ran breeze testing tests --upgrade-boto tests/providers/docker in main branch with latest CI image - getting same error results.
Celery integration test seems flaky, no?

[potiuk]

I ran breeze testing tests --upgrade-boto tests/providers/docker in main branch with latest CI image - getting same error results.

#39747 should fix the docker test in "Latest Botocore".

[mobuchowski]

@JDarDagran we probably need to bump cross-provider version dependencies. If someone has older OL provider version, and bumps some of the other provider versions, the openlineage methods will fail.

[potiuk]

As discussed with @mobuchowski -> we need to add back-compatibility try/import to past versions of the openlineage provider. We could even potentially add back-compatibility test suite for older version of of openlineage client < 1.13 to test it (symiliar to what we have in Pydantic/Botocore cases.

[JDarDagran]

I've added imports with weird-looking structure at first glance:

ifTYPE_CHECKING:
# v2 importselse:
try:
# v2 importsexceptImportError:
# v1 imports

This satisfies mypy and works with previous OL provider versions.
I'll be adding backwards-compatibility cross-provider checks in separate PR soon.

[potiuk]

Should we re-start discussion about common provider for that one? I have an idea..

[kacpermuda]

That's a huge amount of work done, thanks @JDarDagran 🚀 I left some nit comments

[JDarDagran]

@potiuk looks like I'm on green path finally consistently 🟢 Would love to get this merged soon as new features arrive and I still need to rebase and apply new imports :)