Skip to content

Metric updates for FhirIO: Fix metrics + namings to be consistent. - #13792

Merged
pabloem merged 4 commits into
apache:masterfrom
msbukal:METRICS
Jan 26, 2021
Merged

Metric updates for FhirIO: Fix metrics + namings to be consistent.#13792
pabloem merged 4 commits into
apache:masterfrom
msbukal:METRICS

Conversation

@msbukal

Copy link
Copy Markdown
Contributor

Add success, failure and latency metrics to FHIRIO read, execute bundle and search methods.
Update metric naming to adhere to a consistent standard, and fixed incorrect metric names (eg. "successful-hl7v2-message-gets" for FhirIO.Read).
Update latency measurements to recommended java 8 time approach (java.time.Instant)


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Choose reviewer(s) and mention them in a comment (R: @username).
  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

Post-Commit Tests Status (on master branch)

LangSDKDataflowFlinkSamzaSparkTwister2
GoBuild Status---Build Status---Build Status---
JavaBuild StatusBuild Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build StatusBuild Status
Build Status
Build Status
Build Status
PythonBuild Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
---Build Status---
XLangBuild StatusBuild StatusBuild Status---Build Status---

Pre-Commit Tests Status (on master branch)

---JavaPythonGoWebsiteWhitespaceTypescript
Non-portableBuild StatusBuild Status
Build Status
Build Status
Build Status
Build StatusBuild StatusBuild StatusBuild Status
Portable---Build Status------------

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests

See CI.md for more information about GitHub Actions CI.

@msbukal

Copy link
Copy Markdown
ContributorAuthor

I believe the failure in "Run Java PreCommit" is a flake, I was unable to reproduce it.

@msbukal

Copy link
Copy Markdown
ContributorAuthor

R: @pabloem

@pabloem

Copy link
Copy Markdown
Member

Run Java PreCommit

@pabloem

Copy link
Copy Markdown
Member

thanks @msbukal - these will be useful to debug jobs, and may be useful for perf tests if they're ever implemented.

@pabloem

Copy link
Copy Markdown
Member

Run Java PreCommit

@pabloem

Copy link
Copy Markdown
Member

this is clearly an unrelated flake. FWIW, this change LGTM, so no more action needed from you @msbukal

I'll rerun presubmits until we get a green run

@pabloem

Copy link
Copy Markdown
Member

Run Java PreCommit

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh there seems to be a style error for these variables. They should be static, or not capitalized. fyi: @msbukal

[ant:checkstyle] [ERROR] /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Phrase/src/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/FhirIO.java:1614:31: Name 'SEARCH_RESOURCE_ERRORS' must match pattern '^[a-z][a-zA-Z0-9]*$'. [MemberName] | | [ant:checkstyle] [ERROR] /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Phrase/src/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/FhirIO.java:1617:31: Name 'SEARCH_RESOURCE_SUCCESS' must match pattern '^[a-z][a-zA-Z0-9]*$'. [MemberName] | | [ant:checkstyle] [ERROR] /home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Phrase/src/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/healthcare/FhirIO.java:1620:36: Name 'SEARCH_RESOURCE_LATENCY_MS' must match pattern '^[a-z][a-zA-Z0-9]*$'. [MemberName]

Usually, when a unit test fails, it is displayed directly in Jenkins. In this case it wasn't, because it was something else failing.

To find these kinds of errors, you can open PreCommit, and then open the Gradle Build Scan, which will point you to the failing task.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah I see, these fields can't be static because of the template (keep going round & round in errors due to this) which means that the metric fields can't be static.

I've renamed them.

@codecov

codecovBot commented Jan 26, 2021

Copy link
Copy Markdown

Codecov Report

Merging #13792 (390fb7e) into master (0dd6980) will increase coverage by 0.00%.
The diff coverage is n/a.

Impacted file tree graph

@@ Coverage Diff @@## master #13792 +/- ##
=======================================
Coverage 82.76% 82.77% =======================================
Files 466 466 Lines 57558 57558 =======================================
+ Hits 47638 47641 +3 + Misses 9920 9917 -3 
Impacted FilesCoverage Δ
sdks/python/apache_beam/io/iobase.py84.55% <0.00%> (-0.27%)⬇️
...hon/apache_beam/runners/worker/bundle_processor.py93.83% <0.00%> (+0.38%)⬆️
sdks/python/apache_beam/utils/interactive_utils.py95.23% <0.00%> (+2.38%)⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 29b9542...075e70b. Read the comment docs.

@pabloem

Copy link
Copy Markdown
Member

precommit error is unrelated (in fact, it's my fault in a different PR) - I'll merge once I fix precommit on master

@pabloempabloem closed this Jan 26, 2021
@pabloempabloem reopened this Jan 26, 2021
@pabloem

Copy link
Copy Markdown
Member

closing and opening hoping to retrigger the tests and the merge at the top of master (since now it has the fix for the breakage)

@pabloem

Copy link
Copy Markdown
Member

Run Java PreCommit

1 similar comment
@pabloem

Copy link
Copy Markdown
Member

Run Java PreCommit

@pabloem
pabloem merged commit dde38b6 into apache:masterJan 26, 2021
@msbukal
msbukal deleted the METRICS branch February 19, 2021 19:39
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@msbukal@pabloem