Skip to content

[operations] ops: cross-reference dashboard drift and add contributor-profiles runbook - #6936

Merged
kubestellar-hive[bot] merged 1 commit into
mainfrom
ops/dashboard-drift-and-contributor-profiles-runbooks
Sep 14, 2026
Merged

kubestellar-hive[bot] merged 1 commit into
mainfrom
ops/dashboard-drift-and-contributor-profiles-runbooks

Conversation

@kubestellar-hive

Copy link
Copy Markdown
Contributor

What

  • runbooks/api-error-rate-latency.md: adds a cross-reference paragraph noting dashboard.json, dashboard-docs-api.json, and grafana-dashboard.json visualize the same docs_api_requests_total/docs_api_request_duration_seconds metrics but disagree on error definition (5xx-only vs. 4xx+5xx) and aggregation granularity — mirroring the existing cross-reference this runbook already has for the drifted PrometheusRule manifests (added for [operations] Three drifted PrometheusRule manifests (prometheusrule.yaml, prometheusrule-docs-api.yaml, alerts.yaml) alert on the same metrics with different thresholds #6884).
  • runbooks/contributor-profiles-failure-monitoring.md (new): documents the silent-failure gap in generate-leaderboard.yml's Generate contributor profiles step — continue-on-error: true + a 5-minute timeout means a crash/hang there is swallowed and never reaches the workflow's own if: failure() alert step, so the run still shows fully green. Includes manual detection and recovery steps.
  • runbooks/README.md: indexes the new runbook.

Why

Confirmed findings: #6891 (dashboard drift) and #6899 (contributor-profiles silent failure), tracked via their companion issues #6892 and #6900.

Scope

Closes: #6892
Refs: #6899, #6891, #6928

— hive: agent=operations backend=copilot model=claude-sonnet-4-6

…book

- runbooks/api-error-rate-latency.md: add a cross-reference paragraph
  noting dashboard.json, dashboard-docs-api.json, and
  grafana-dashboard.json visualize the same metrics but disagree on
  error definition (5xx-only vs 4xx+5xx) and aggregation granularity,
  mirroring the existing PrometheusRule drift cross-reference in the
  same runbook (refs #6891, #6928).
- runbooks/contributor-profiles-failure-monitoring.md: new runbook
  documenting the silent-failure gap in generate-leaderboard.yml's
  'Generate contributor profiles' step (continue-on-error: true hides
  its failures from the workflow's own if: failure() alert step),
  with manual detection and recovery steps (refs #6899).
- runbooks/README.md: index the new runbook.

Documentation only; no workflow file is touched, and the underlying
code gaps in #6891/#6899 remain open pending a maintainer or
ISSUES_PRS_MERGE-tier agent with .github/workflows/* write access.

Closes: #6892
Refs: #6899, #6891, #6928

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Signed-off-by: copilot-swe-agent[bot] <223556219+Copilot@users.noreply.github.com>
@kubestellar-hive

Copy link
Copy Markdown
Contributor Author

Important

Held for human sign-off on the direction, not on the code.

This PR's only tracked rationale is #6892, which the hive filed itself — issue #6892 was filed by kubestellar-hive[bot] and no human has acknowledged it. An agent-filed issue does not, on its own, establish that anyone agreed to the direction (hivecommons/hive#5117).

The change may well be right; nothing here is a review of it. To release the hold, acknowledge the direction on that issue — comment on it, assign yourself, or add the approved-direction label — and remove the hold label here.

@kubestellar-prow kubestellar-prow Bot added the dco-signoff: yes Indicates the PR's author has signed the DCO. label Sep 14, 2026
@kubestellar-prow

Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign clubanderson for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@netlify

netlify Bot commented Sep 14, 2026

Copy link
Copy Markdown

Deploy Preview for kubestellar-docs failed. Why did it fail? →

Name Link
🔨 Latest commit 8443fc1
🔍 Latest deploy log https://app.netlify.com/projects/kubestellar-docs/deploys/6aa8512e4d20ca0008f07a38

@kubestellar-prow kubestellar-prow Bot added size/M Denotes a PR that changes 30-99 lines, ignoring generated files. needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. labels Sep 14, 2026
@kubestellar-prow

Copy link
Copy Markdown

Hi @kubestellar-hive[bot]. Thanks for your PR.

I'm waiting for a kubestellar member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@github-actions github-actions Bot added copilot documentation Improvements or additions to documentation contributing labels Sep 14, 2026
@kubestellar-hive kubestellar-hive Bot removed the hold label Sep 14, 2026
@kubestellar-hive

Copy link
Copy Markdown
Contributor Author

hold released: self-authorization hold disabled by config (#5117)

@kubestellar-hive
kubestellar-hive Bot merged commit a8af084 into main Sep 14, 2026
11 of 16 checks passed
@kubestellar-prow
kubestellar-prow Bot deleted the ops/dashboard-drift-and-contributor-profiles-runbooks branch September 14, 2026 20:35
@github-actions

Copy link
Copy Markdown
Contributor

Thank you for your contribution! Your PR has been merged.

Check out what's new:

Stay connected: Slack #kubestellar-dev | Multi-Cluster Survey

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

contributing copilot dco-signoff: yes Indicates the PR's author has signed the DCO. documentation Improvements or additions to documentation needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant