Add transport parameter to CloudRunHook and CloudRunExecuteJobOperator

[arjav1528]

Fixes#60389

Summary

Adds support for specifying the transport protocol (REST or gRPC) in CloudRunHook, CloudRunAsyncHook, CloudRunExecuteJobOperator, and CloudRunJobFinishedTrigger to resolve 404 errors in Docker environments where gRPC transport fails.

Problem

CloudRunExecuteJobOperator fails with 404 errors (NotFound: 404 Requested entity was not found) when running in Docker containers, even though the same Cloud Run jobs work correctly with gcloud CLI. This occurs because the Google Cloud Python client defaults to gRPC transport, which can fail in Docker environments due to network configurations, proxy settings, or firewall restrictions.

Solution

Added an optional transport parameter to:

• CloudRunHook - allows specifying 'rest' or 'grpc' transport for JobsClient
• CloudRunAsyncHook - allows specifying transport for JobsAsyncClient
• CloudRunExecuteJobOperator - passes transport parameter to the hook
• CloudRunJobFinishedTrigger - passes transport parameter to async hook for deferrable operations

[shahar1]

Overall LGTM with a small comment - please fix it and I'll approve.

CC: @VladaZakharova@MaksYermak@olegkachur-e

[arjav1528]

@uranusjr could you please approve the changes and merge the PR

[MaksYermak]

Hello @shahar1!
This PR broke the deferrable mode for CloudRunExecuteJobOperator could you revert this PR?
Here is the screenshot from the last run of the system test:

[shahar1]

Hello @shahar1!
This PR broke the deferrable mode for CloudRunExecuteJobOperator could you revert this PR?
Here is the screenshot from the last run of the system test:

Thanks for informing, I'll take care of it later on - I had merged it before our discussion regarding the system tests.
As I'm also the the release manager of the next provider wave, I'll ensure that it's get reverted by then.
I'll be happy to discuss with your team regarding the integration of the system tests to the repo's CI, so we could run specific system twsts before merging / getting alerted on Airflow's slack channel.