[BEAM-8676] sdks/java: gax and grpc upgrades

[suztomo]

https://issues.apache.org/jira/browse/BEAM-8676

Gax and gRPC work together. Upgrading their dependencies to higher versions.

• The latest gax-grpc:1.52.0 depends on gRPC 1.25.0. (So not setting grpc 1.26.0)

Which modules use gax and grpc?

find . -name 'build.gradle' |xargs grep -ir library.java.gax gave

• ./sdks/java/io/google-cloud-platform/build.gradle
• ./sdks/java/extensions/sql/datacatalog/build.gradle
• ./sdks/java/extensions/sql/zetasql/build.gradle

Linkage Check

beam-sdks-java-io-google-cloud-platform

• before:
• after:

beam-sdks-java-extensions-sql-zetasql

Linkage Checker does not work for beam-sdks-java-extensions-sql-zetasql. (Bug: GoogleCloudPlatform/cloud-opensource-java#1087)

beam-sdks-java-extensions-sql-datacatalog

• before:
• after:

---

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

• Choose reviewer(s) and mention them in a comment (R: @username).
• Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
• If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

Post-Commit Tests Status (on master branch)

Lang	SDK	Apex	Dataflow	Flink	Gearpump	Samza	Spark
Go		---	---		---	---
Java
Python		---			---	---
XLang	---	---	---		---	---	---

Pre-Commit Tests Status (on master branch)

---	Java	Python	Go	Website
Non-portable
Portable	---		---	---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

[suztomo]

As BigQueryServicesImpl uses gax's com.google.api.gax.core.FixedCredentialsProvider (undeclared-but-used dependency), declaring it explicitly.

[suztomo]

The latest version of gRPC is 1.26.0, but setting 1.25.0 as gax-grpc:1.52.0 depends on 1.25.0.

[suztomo]

R: @kennknowles

[suztomo]

R: @lukecwik@chamikaramj

[suztomo]

Run SQL Postcommit

[suztomo]

retest this please

[suztomo]

Run Java PostCommit

[suztomo]

Run Java HadoopFormatIO Performance Test

[suztomo]

Run BigQueryIO Streaming Performance Test Java

[suztomo]

Run Dataflow ValidatesRunner

[suztomo]

Run Spark ValidatesRunner

[suztomo]

Run SQL Postcommit

[suztomo]

retest this please

[suztomo]

retest this please

[suztomo]

Run Java PostCommit

[suztomo]

Run Java PostCommit

[lukecwik]

Please post the before and after results of the linkage checker for the GCP IO module.

Swapping to gRPC 1.25 suggests to update protobuf to 3.11.0 and guava to 28.1. Upgrading those may need to happen before this change could be adopted depending on the linkage checker results.

This seems like an innocuous change but past experience has shown that grpc/proto/guava like to make breaking changes.

[suztomo]

Swapping to gRPC 1.25 suggests to update protobuf to 3.11.0 and guava to 28.1

Good point. The current protobuf 3.6.0 is not compatible with gax-grpc 1.52.0. Let me update that first. I'll attach linkage check result on that PR.

[suztomo]

Raised #10498 for protobuf upgrade. Jenkins is not running tests (yet?).

[suztomo]

https://gist.github.com/suztomo/9af333b78b157d6a829d59ac5353e01d

Linkage Error on com.google.auth:google-auth-library-oauth2-http:0.12.0 x com.google.api:gax:1.52.0
(com.google.auth:google-auth-library-oauth2-http:0.12.0) com.google.auth.oauth2.ServiceAccountCredentials's method getQuotaProjectId() is not found (type: SYMBOL_NOT_FOUND)
com.google.api.gax.core.GoogleCredentialsProvider (com.google.api:gax:1.52.0)
(com.google.auth:google-auth-library-oauth2-http:0.12.0) com.google.auth.oauth2.ServiceAccountJwtAccessCredentials$Builder's method setQuotaProjectId(String arg1) is not found (type: SYMBOL_NOT_FOUND)
com.google.api.gax.core.GoogleCredentialsProvider (com.google.api:gax:1.52.0)

This PR needs #10508 first.