[Go SDK] Add more info to Worker Status API

[riteshghorse]

Adds Memory Usage information, Cache Stats, and Active Process Bundle States to worker status API added in #16957

Example Output (on Dataflow):

============Memory Usage============ heap in-use-spans/allocated/total/max = 5/4/15/7 MB stack in-use-spans/max = 0/0 MB GC-CPU percentage = 0.00 % Last GC time: 2022-06-10 16:34:35.629059975 +0000 UTC Next GC: 6 MB ============Active Process Bundle States============ Bundle ID: process_bundle-369391211043651523-0 Bundle State: PTransform ID: CountWords/wordcount.extractFn-ptransform-40 Current state: Process Bundle All Bundle Process States: Bundle ID: CountWords/stats.Count/stats.keyedCountFn-ptransform-41 Execution State: State: Start Bundle IsProcessing: false Total time: 0s Execution State: State: Start Bundle IsProcessing: false Total time: 0s Execution State: State: Start Bundle IsProcessing: false Total time: 0s Execution State: State: Start Bundle IsProcessing: false Total time: 0s Bundle ID: CountWords/wordcount.extractFn-ptransform-40 Execution State: State: Start Bundle IsProcessing: false Total time: 0s Execution State: State: Start Bundle IsProcessing: false Total time: 9m57.8s Execution State: State: Start Bundle IsProcessing: false Total time: 0s Execution State: State: Start Bundle IsProcessing: false Total time: 9m57.8s Bundle ID: beam.createFn-ptransform-39 Execution State: State: Start Bundle IsProcessing: false Total time: 0s Execution State: State: Start Bundle IsProcessing: false Total time: 0s Execution State: State: Start Bundle IsProcessing: false Total time: 0s Execution State: State: Start Bundle IsProcessing: false Total time: 0s Bundle ID: CountWords/stats.Count/stats.SumPerKey/CombinePerKey/CoGBK+CountWords/stats.Count/stats.SumPerKey/CombinePerKey/stats.sumIntFn/Partial-ptransform-42 Execution State: State: Start Bundle IsProcessing: false Total time: 0s Execution State: State: Start Bundle IsProcessing: false Total time: 0s Execution State: State: Start Bundle IsProcessing: false Total time: 0s Execution State: State: Start Bundle IsProcessing: false Total time: 0s
============Cache Stats============ State Cache: {Hits:0 Misses:0 Evictions:0 InUseEvictions:0 ReStreamErrors:0} ============Goroutine Dump============ goroutine profile: total 24 4 @ 0x438e96 0x431897 0x463909 0x49f1d2 0x4a053a 0x4a0528 0x6d2349 0x6e3d05 0x524874

See the bottom of https://docs.google.com/document/d/1dMTD5_sKdzLcnoe0ZsQU5Wf9q11uliyYgFnnOZQDzuI/ for more details.

---

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

• Choose reviewer(s) and mention them in a comment (R: @username).
• Mention the appropriate issue in your description (for example: "addresses [BEAM-121] Add DisplayData for IO transforms #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment "fixes #" instead.
• Update CHANGES.md with noteworthy changes.
• If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI.

[asf-ci]

Can one of the admins verify this patch?

[asf-ci]

Can one of the admins verify this patch?

[codecov]

Codecov Report

Merging #21776 (ac6fc70) into master (7bf822a) will decrease coverage by 0.02%.
The diff coverage is 38.70%.

@@ Coverage Diff @@## master #21776 +/- ##
==========================================
- Coverage 74.09% 74.07% -0.03% 
==========================================
Files 698 698 Lines 92503 92574 +71 ==========================================
+ Hits 68544 68577 +33 - Misses 22704 22742 +38 
Partials 1255 1255 

Flag	Coverage Δ
go	50.82% <38.70%> (-0.02%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
sdks/go/pkg/beam/core/metrics/store.go	10.63% <0.00%> (-4.99%)	⬇️
sdks/go/pkg/beam/core/runtime/harness/harness.go	10.20% <0.00%> (-0.09%)	⬇️
...beam/core/runtime/harness/statecache/statecache.go	74.65% <0.00%> (-2.11%)	⬇️
.../go/pkg/beam/core/runtime/harness/worker_status.go	72.36% <94.73%> (+21.20%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7bf822a...ac6fc70. Read the comment docs.

[riteshghorse]

Run GoPortable PostCommit

[github-actions]

Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment assign set of reviewers

[lostluck]

We can remove this change. At best, we mostly want to remove the blank line between "strings" and "fmt".

[lostluck]

Please add documentation around "expected" Environment variables. TBH, I don't mind the options approach to pass into main, but the fetching form the Env vars would then happen in the init.go.

[github-actions]

Assigning reviewers. If you would like to opt out of this review, comment assign to next reviewer:

R: @jrmccluskey for label go.

Available commands:

• stop reviewer notifications - opt out of the automated review tooling
• remind me after tests pass - tag the comment author after tests pass
• waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

[lostluck]

Run Go Postcommit

[riteshghorse]

Made the changes, PTAL

[riteshghorse]

Run Go PostCommit