[DO NOT MERGE] Run all PostCommit and PreCommit Tests against Release Branch by youngoli · Pull Request #17259 · apache/beam

youngoli · 2022-04-04T02:53:53Z

You can run many tests automatically using release/src/main/scripts/mass_comment.py.

…ate a test PR

youngoli · 2022-04-04T03:43:24Z

Run CommunityMetrics PreCommit

youngoli · 2022-04-04T03:43:24Z

Run Dataflow Runner Nexmark Tests

youngoli · 2022-04-04T03:43:25Z

Run Dataflow Runner V2 Java 11 Nexmark Tests

youngoli · 2022-04-04T03:43:26Z

Run Dataflow Runner V2 Java 17 Nexmark Tests

youngoli · 2022-04-04T03:43:26Z

Run Dataflow Runner V2 Nexmark Tests

youngoli · 2022-04-04T03:43:27Z

Run Dataflow Streaming ValidatesRunner

youngoli · 2022-04-04T03:43:28Z

Run Dataflow ValidatesRunner Java 11

youngoli · 2022-04-04T03:43:28Z

Run Dataflow ValidatesRunner Java 17

youngoli · 2022-04-04T03:43:29Z

Run Dataflow ValidatesRunner

youngoli · 2022-04-04T03:43:30Z

Run Direct Runner Nexmark Tests

youngoli · 2022-04-04T03:43:30Z

Run Direct ValidatesRunner Java 11

youngoli · 2022-04-04T03:43:31Z

Run Direct ValidatesRunner Java 17

youngoli · 2022-04-04T03:43:32Z

Run Direct ValidatesRunner in Java 11

youngoli · 2022-04-04T03:43:33Z

Run Direct ValidatesRunner

youngoli · 2022-04-04T03:43:34Z

Run Flink Runner Nexmark Tests

youngoli · 2022-04-04T03:43:34Z

Run Flink ValidatesRunner Java 11

youngoli · 2022-04-04T03:43:35Z

Run Flink ValidatesRunner

youngoli · 2022-04-04T03:43:36Z

Run Go Flink ValidatesRunner

youngoli · 2022-04-04T03:43:36Z

Run Go PostCommit

youngoli · 2022-04-04T03:43:37Z

Run Go PreCommit

youngoli · 2022-04-04T03:43:38Z

Run Go Samza ValidatesRunner

youngoli · 2022-04-04T03:43:38Z

Run Go Spark ValidatesRunner

youngoli · 2022-04-04T03:43:39Z

Run GoPortable PreCommit

youngoli · 2022-04-04T03:43:40Z

Run Java 11 Examples on Dataflow Runner V2

youngoli · 2022-04-04T03:43:40Z

Run Java 17 Examples on Dataflow Runner V2

youngoli · 2022-04-04T03:43:41Z

Run Java Dataflow V2 ValidatesRunner Streaming

youngoli · 2022-04-04T03:43:42Z

Run Java Dataflow V2 ValidatesRunner

youngoli · 2022-04-04T03:43:42Z

Run Java Examples on Dataflow Runner V2

youngoli · 2022-04-04T03:43:43Z

Run Java Examples_Direct

youngoli · 2022-04-04T03:44:06Z

Run Python 3.8 PostCommit

youngoli · 2022-04-04T03:44:06Z

Run Python 3.9 PostCommit

youngoli · 2022-04-04T03:44:07Z

Run Python Dataflow V2 ValidatesRunner

youngoli · 2022-04-04T03:44:08Z

Run Python Dataflow ValidatesContainer

youngoli · 2022-04-04T03:44:08Z

Run Python Dataflow ValidatesRunner

youngoli · 2022-04-04T03:44:09Z

Run Python Examples_Dataflow

youngoli · 2022-04-04T03:44:09Z

Run Python Examples_Direct

youngoli · 2022-04-04T03:44:10Z

Run Python Examples_Flink

youngoli · 2022-04-04T03:44:11Z

Run Python Examples_Spark

youngoli · 2022-04-04T03:44:11Z

Run Python Flink ValidatesRunner

youngoli · 2022-04-04T03:44:12Z

Run Python PreCommit

youngoli · 2022-04-04T03:44:13Z

Run Python Samza ValidatesRunner

youngoli · 2022-04-04T03:44:13Z

Run Python Spark ValidatesRunner

youngoli · 2022-04-04T03:44:14Z

Run PythonDocker PreCommit

youngoli · 2022-04-04T03:44:15Z

Run PythonDocs PreCommit

youngoli · 2022-04-04T03:44:15Z

Run PythonFormatter PreCommit

youngoli · 2022-04-04T03:44:16Z

Run PythonLint PreCommit

youngoli · 2022-04-04T03:44:16Z

Run Python_PVR_Flink PreCommit

codecov · 2022-04-04T04:56:51Z

Codecov Report

Merging #17259 (92ca0bd) into release-2.38.0 (47a9d8f) will decrease coverage by 0.00%.
The diff coverage is n/a.

@@ Coverage Diff @@## release-2.38.0 #17259 +/- ##
==================================================
- Coverage 73.96% 73.96% -0.01% 
==================================================
Files 672 672 Lines 88259 88270 +11 ==================================================
+ Hits 65279 65287 +8 - Misses 21867 21870 +3 
Partials 1113 1113

Flag	Coverage Δ
python	`83.63% <ø> (-0.01%)`	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...che_beam/runners/interactive/interactive_runner.py	`92.85% <0.00%> (-0.72%)`	⬇️
...hon/apache_beam/runners/worker/bundle_processor.py	`93.26% <0.00%> (-0.25%)`	⬇️
.../apache_beam/options/pipeline_options_validator.py	`98.90% <0.00%> (+0.03%)`	⬆️
...dks/python/apache_beam/options/pipeline_options.py	`94.91% <0.00%> (+0.05%)`	⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 47a9d8f...92ca0bd. Read the comment docs.

youngoli · 2022-04-04T23:54:47Z

Run Flink ValidatesRunner Java 11

youngoli · 2022-04-05T04:29:17Z

Run Dataflow Runner V2 Nexmark Tests

youngoli · 2022-04-05T04:57:38Z

Run Dataflow ValidatesRunner Java 17

youngoli · 2022-04-05T05:53:48Z

Logging my triaging on all the failing targets for transparency.

Non-release blocking failures:
CommunityMetrics - Problem in our test infrastructure preventing metrics from being uploaded. Unrelated to Beam itself.
Google Cloud Dataflow Portability Runner Examples Java 11 - False negative. The build is successful but no tests are run and Jenkins reports that as a failure.
[Google Cloud Dataflow Runner V2 Examples](Google Cloud Dataflow Runner V2 Examples) - False negative, same as above.
Java Flink PortableValidatesRunner Streaming Tests - Only error has apparently been failing since being added, which is not a significant regression and therefore not release-blocking. BEAM-14254
Java Samza PortableValidatesRunner Tests - Only failure is the same as the Flink one above, and it's because Samza doesn't support the feature being tested.
Java Spark v2 PortableValidatesRunner Streaming Tests - Not considered release-blocking since the test suite was never consistently green to begin with. See BEAM-13950.
Python 3.7 PostCommit - Almost certainly a test configuration error and probably a flake. Failing to connect to a bigquery table. I'll be trying to deflake this just in case.
PythonDocs PreCommit - Fixed by #17176, I missed that during cherrypicks. Easy fix.

Further investigation needed:
Dataflow Java Post Commit Tests - Many failures. Most seem likely to be non-release blocking, but still looking into it. BEAM-14252
Dataflow V2 Java Post Commit Tests - Fewer failures than above, but some are identical failures and covered by the JIRA above. Then there's two spanner test failures that seem to be due to an incorrect config. Only new failure is not release-blocking (BEAM-14263).
JPMS Java 11 Dataflow Post Commit Tests and JPMS Java 17 Dataflow Post Commit Tests - Failing due to lack of Dataflow worker container for 2.38.0. Will need to rerun once it's available.
Java PreCommit - Been constantly timing out recently and being very flaky. Will need to keep rerunning until it doesn't timeout to see if it's actually failing or not.
Java SDK Post Commit Tests - Same failures as the Dataflow Java Post Commit Tests, so investigating BEAM-14252 will cover this.

youngoli · 2022-04-06T19:58:13Z

Run Java PreCommit

youngoli · 2022-04-06T19:58:43Z

Run PostCommit_Java_DataflowV2

youngoli · 2022-04-06T19:58:49Z

Run PostCommit_Java_Dataflow

youngoli · 2022-04-06T21:26:56Z

Run Java PreCommit

youngoli · 2022-04-06T22:51:53Z

Run Java PostCommit

youngoli · 2022-04-06T22:56:00Z

Resolved:
Dataflow Java Post Commit Tests - All bugs on this have been addressed and determined to be non-release blocking. (BEAM-14252)
Dataflow V2 Java Post Commit Tests - Same as above, resolved with BEAM-14252.
Java SDK Post Commit Tests - I forgot to rerun this, but all its failures were covered by BEAM-14252 so it should be resolved now. Will double-check once it's done running.
Java PreCommit - Fixed with cherry-pick #17295.

Changed version.py and gradle.properties to python dev version to cre…
92ca0bd
…ate a test PR

youngoli closed this Jun 8, 2022

Uh oh!

Conversation

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

youngoli commented Apr 4, 2022

Uh oh!

codecovBot commented Apr 4, 2022•
edited
Loading

youngoli commented Apr 5, 2022•
edited
Loading

youngoli commented Apr 6, 2022•
edited
Loading