Skip to content

Modify Prometheus exporter to translate non-monotonic Sums into gauges - #3306

Merged
ocelotl merged 16 commits into
open-telemetry:mainfrom
brettimus:export-nonmonotonic-sums-as-gauges-in-prometheus
Aug 7, 2023
Merged

Modify Prometheus exporter to translate non-monotonic Sums into gauges#3306
ocelotl merged 16 commits into
open-telemetry:mainfrom
brettimus:export-nonmonotonic-sums-as-gauges-in-prometheus

Conversation

@brettimus

@brettimusbrettimus commented May 10, 2023•
edited
Loading

Copy link
Copy Markdown
Contributor

Description

This PR modifies the prometheus exporter code that translates OpenTelemetry metrics into Prometheus metrics.

Prometheus has the concept of a Gauge, which is effectively a non-monotonic Sum. (In the world of Prometheus, a monotonic Sum is called a Counter.)

At present, the code that translates OTEL metrics into Prometheus metrics currently treats all Sums as Prometheus "Counters", regardless of their monotonicity.

Quoting @dashpole in issue #3071

The prometheus compatibility spec for sums says: If the aggregation temporality is cumulative and the sum is non-monotonic, it MUST be converted to a Prometheus Gauge.

Therefore, I've modified the Prometheus exporter to always convert non-monotonic Sums (with cumulative aggregation temporality) into Prometheus Gauges.

Fixes#3071

Type of change

  • Bug fix (non-breaking change which fixes an issue)

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

  • tox -e opentelemetry-exporter-prometheus
  • tox -e lint

Does This PR Require a Contrib Repo Change?

Answer the following question based on these examples of changes that would require a Contrib Repo Change:

  • The OTel specification has changed which prompted this PR to update the method interfaces of opentelemetry-api/ or opentelemetry-sdk/

  • The method interfaces of test/util have changed

  • Scripts in scripts/ that were copied over to the Contrib repo have changed

  • Configuration files that were copied over to the Contrib repo have changed (when consistency between repositories is applicable) such as in

    • pyproject.toml
    • isort.cfg
    • .flake8

  • When a new .github/CODEOWNER is added

  • Major changes to project information, such as in:

    • README.md
    • CONTRIBUTING.md

  • Yes. - Link to PR:

  • No.

Checklist:

  • Followed the style guidelines of this project
  • Changelogs have been updated
  • Unit tests have been added
  • Documentation has been updated (NOT RELEVANT)

@linux-foundation-easycla

linux-foundation-easyclaBot commented May 10, 2023•
edited
Loading

Copy link
Copy Markdown

CLA Signed

The committers listed above are authorized under a signed CLA.

@brettimusbrettimus mentioned this pull request May 10, 2023
Closed
@brettimus
brettimusforce-pushed the export-nonmonotonic-sums-as-gauges-in-prometheus branch from 4777f46 to 01fc016CompareMay 10, 2023 16:28
@brettimus
brettimus marked this pull request as ready for review May 10, 2023 16:29
@brettimus
brettimus requested a review from a teamMay 10, 2023 16:29
This was referenced May 10, 2023
Merged
Closed
@brettimus@brett-fiberplane
Modify Prometheus exporter to translate non-monotonic Sums into gauges
ca4eb1f
Add unit tests for translating monotonic and non-monotonic Sums to prometheus metrics
Update prometheus metric translation to match spec
Added a check for the aggregation temporality of a Sum.
"If the aggregation temporality is cumulative and the sum is non-monotonic, it MUST be converted to a Prometheus Gauge."
Update changelog
@brettimus
brettimusforce-pushed the export-nonmonotonic-sums-as-gauges-in-prometheus branch from 01fc016 to ca4eb1fCompareMay 15, 2023 08:48
@linux-foundation-easycla

linux-foundation-easyclaBot commented May 17, 2023•
edited
Loading

Copy link
Copy Markdown

CLA Signed

The committers listed above are authorized under a signed CLA.

@brettimus
brettimusforce-pushed the export-nonmonotonic-sums-as-gauges-in-prometheus branch from 64110c1 to 0ceeea2CompareMay 17, 2023 22:00
@brettimus

brettimus commented Jun 12, 2023

Copy link
Copy Markdown
ContributorAuthor

hey all! would it be possible to approve and/or merge this before the next release? i contribute to an open source lib that would benefit from this fix

thank you!!

srikanthccv
srikanthccv approved these changes Jun 13, 2023
View reviewed changes
Comment threadexporter/opentelemetry-exporter-prometheus/src/opentelemetry/exporter/prometheus/__init__.py Outdated
@brettimusbrettimus mentioned this pull request Jun 23, 2023
Closed
@brettimus

brettimus commented Jun 26, 2023

Copy link
Copy Markdown
ContributorAuthor

hi there! the only issue in the last run of the workflows had to do with linting afaik.

i just ran tox -e lint locally and everything passed. this PR should be ready to rerun the workflows.

(sorry for that hiccup by the way)

@srikanthccv
srikanthccv requested a review from aabmassJuly 9, 2023 17:08
aabmass
aabmass approved these changes Jul 10, 2023
View reviewed changes

@aabmassaabmass left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR, lgtm

@aabmass

aabmass commented Jul 10, 2023

Copy link
Copy Markdown
Member

@brettimus looks like there are build failures, could you take a look?

@brettimus

brettimus commented Jul 14, 2023

Copy link
Copy Markdown
ContributorAuthor

looks like i needed to update my new test after #3279 was merged

everything is green again locally! though i'm sad i didn't get to this sooner. i missed the release by a day!

@brettimus

brettimus commented Jul 17, 2023

Copy link
Copy Markdown
ContributorAuthor

Okay so everything is green except for the sdk tests for pypy3 on Windows.

The CI logs suggest that the error is unrelated to my change. Have any of you seen this before?

image

@srikanthccvsrikanthccv added the PR:please merge This PR is ready to be merged by a Maintainer (has enough valid approvals, successful build, etc.) label Jul 17, 2023
@brettimus

brettimus commented Jul 20, 2023

Copy link
Copy Markdown
ContributorAuthor

heck yeah! all green 🟢

@ocelotl
ocelotl enabled auto-merge (squash) August 7, 2023 12:59
@ocelotl
ocelotl merged commit c9277ff into open-telemetry:mainAug 7, 2023
@dashpoledashpole mentioned this pull request Sep 20, 2023
Merged
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@aabmassaabmassaabmass approved these changes
+1 more reviewer
@srikanthccvsrikanthccvsrikanthccv approved these changes
Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

PR:please mergeThis PR is ready to be merged by a Maintainer (has enough valid approvals, successful build, etc.)

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Prometheus exporter should convert non-monotonic sums to gauges

4 participants

@brettimus@aabmass@srikanthccv@ocelotl