Skip to content

OTA-1637: ClusterOperators should not go Progressing only for a node reboot - #30296

Merged
openshift-merge-bot[bot] merged 3 commits into
openshift:mainfrom
hongkailiu:OTA-1637-reboot
Oct 28, 2025
Merged

OTA-1637: ClusterOperators should not go Progressing only for a node reboot#30296
openshift-merge-bot[bot] merged 3 commits into
openshift:mainfrom
hongkailiu:OTA-1637-reboot

Conversation

@hongkailiu

@hongkailiuhongkailiu commented Sep 23, 2025

Copy link
Copy Markdown
Member

This is to cover the node rebooting case from the rule [1] that is introduced recently:

Operators should not report Progressing only because DaemonSets
owned by them are adjusting to a new node from cluster scaleup or
a node rebooting from cluster upgrade.

The test fails if

  • co/machine-config never became Progressing=True during a
    cluster upgrade, or
  • some CO left Progressing=False during the upgrade after
    machine-config became Progressing=True. This should not
    have taken place as machine-config was rebooting the nodes
    which was the only thing ongoing to the cluster during that
    time.

[1]. https://github.com/openshift/api/blob/61248d910ff74aef020492922d14e6dadaba598b/config/v1/types_cluster_operator.go#L163-L164

@openshift-ci-robotopenshift-ci-robot added the jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. label Sep 23, 2025
@openshift-ci-robot

openshift-ci-robot commented Sep 23, 2025

Copy link
Copy Markdown

@hongkailiu: This pull request references OTA-1637 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.21.0" version, but no target version was set.

Details

In response to this:

This is to cover the node rebooting case from the rule [1] that is introduced recently:

Operators should not report Progressing only because DaemonSets
owned by them are adjusting to a new node from cluster scaleup or
a node rebooting from cluster upgrade.

[1]. https://github.com/openshift/api/blob/61248d910ff74aef020492922d14e6dadaba598b/config/v1/types_cluster_operator.go#L163-L164

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@hongkailiu
hongkailiuforce-pushed the OTA-1637-reboot branch 2 times, most recently from 22125c5 to dbb8c76CompareSeptember 23, 2025 18:29
@openshift-ci-robot

openshift-ci-robot commented Sep 23, 2025

Copy link
Copy Markdown

@hongkailiu: This pull request references OTA-1637 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.21.0" version, but no target version was set.

Details

In response to this:

This is to cover the node rebooting case from the rule [1] that is introduced recently:

Operators should not report Progressing only because DaemonSets
owned by them are adjusting to a new node from cluster scaleup or
a node rebooting from cluster upgrade.

The test fails if

  • co/machine-config never became Progressing=True during a
    cluster upgrade, or
  • some CO left Progressing=False during the upgrade after
    machine-config became Progressing=True. This should not
    have taken place as machine-config was rebooting the nodes
    which was the only thing ongoing to the cluster during that
    time.

[1]. https://github.com/openshift/api/blob/61248d910ff74aef020492922d14e6dadaba598b/config/v1/types_cluster_operator.go#L163-L164

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@hongkailiu

Copy link
Copy Markdown
MemberAuthor

/test e2e-aws-ovn-upgrade

@openshift-trt

Copy link
Copy Markdown

Job Failure Risk Analysis for sha: dbb8c76

Job NameFailure Risk
pull-ci-openshift-origin-main-e2e-aws-csiMedium
Job run should complete before timeout
This test has passed 83.33% of 6 runs on release 4.21 [Architecture:amd64 FeatureSet:default Installer:ipi JobTier:standard Network:ovn NetworkStack:ipv4 Owner:eng Platform:aws Procedure:none SecurityMode:default Topology:ha Upgrade:none] in the last week.
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-upgradeIncompleteTests
Tests for this run (2140) are below the historical average (4244): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New tests seen in this PR at sha: dbb8c76

  • "[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-packageserver should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • (...showing 20 of 33 tests)

@hongkailiu

Copy link
Copy Markdown
MemberAuthor

/payload-job-with-prs periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade #30296

@openshift-ci

Copy link
Copy Markdown
Contributor

@hongkailiu: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/1adde290-995e-11f0-9d57-8ba68c7fd024-0

@openshift-ci

Copy link
Copy Markdown
Contributor

@hongkailiu: This PR was included in a payload test run from #30296
trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/1adde290-995e-11f0-9d57-8ba68c7fd024-0

@hongkailiu

hongkailiu commented Sep 24, 2025

Copy link
Copy Markdown
MemberAuthor

The payload cmd above is working. The triggered job shows the code spotted some violations but also missed a few (comparing to the COs with Progressing=True in the spyclass).

Screenshot 2025-09-24 at 17 29 55
  • caught
    • dns
    • image-registry
    • network
    • node-tuning
    • storage
  • missed
    • kube-storage-version-migrator
    • csi-snapshot-controller
    • ingress
    • service-ca

Refining the code to see why missed.

@hongkailiu

Copy link
Copy Markdown
MemberAuthor

/payload-job-with-prs periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade #30296

@openshift-ci

Copy link
Copy Markdown
Contributor

@hongkailiu: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/05382750-998d-11f0-963e-c3b711331506-0

@openshift-ci

Copy link
Copy Markdown
Contributor

@hongkailiu: This PR was included in a payload test run from #30296
trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/05382750-998d-11f0-963e-c3b711331506-0

@openshift-trt

Copy link
Copy Markdown

Job Failure Risk Analysis for sha: bad744e

Job NameFailure Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-edge-zonesMedium
Job run should complete before timeout
This test has passed 82.34% of 4739 runs on release 4.21 [Overall] in the last week.
pull-ci-openshift-origin-main-e2e-aws-ovn-single-node-upgradeIncompleteTests
Tests for this run (2159) are below the historical average (4037): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New tests seen in this PR at sha: bad744e

  • "[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-packageserver should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • (...showing 20 of 33 tests)

@hongkailiu

Copy link
Copy Markdown
MemberAuthor

https://prow.ci.openshift.org/view/gs/test-platform-results/logs/openshift-origin-30296-openshift-origin-30296-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade/1970962887476252672

Same caught list before, still missing something.

Let us try again with total number of events:

/payload-job-with-prs periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade #30296

@openshift-ci

Copy link
Copy Markdown
Contributor

@hongkailiu: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/5e26f440-9a14-11f0-8659-71352787cde2-0

@openshift-ci

Copy link
Copy Markdown
Contributor

@hongkailiu: This PR was included in a payload test run from #30296
trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/5e26f440-9a14-11f0-8659-71352787cde2-0

@openshift-trt

Copy link
Copy Markdown

Job Failure Risk Analysis for sha: d415550

Job NameFailure Risk
pull-ci-openshift-origin-main-e2e-aws-ovn-microshiftIncompleteTests
Tests for this run (22) are below the historical average (1298): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-main-e2e-aws-ovn-microshift-serialIncompleteTests
Tests for this run (22) are below the historical average (662): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New tests seen in this PR at sha: d415550

  • "[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-packageserver should stay Progressing=False while MCO is Progressing=True" [Total: 3, Pass: 3, Fail: 0, Flake: 0]
  • (...showing 20 of 33 tests)

@hongkailiu

Copy link
Copy Markdown
MemberAuthor

Let us see if https://github.com/openshift/origin/compare/d41555013e72e50e055e6fc1ecf38229560c5b35..969fcc5a0bf55a5242c3e57a302f9e2fd2a04370 helps.

/payload-job-with-prs periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade #30296

@openshift-ci

Copy link
Copy Markdown
Contributor

@hongkailiu: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/7f025ef0-9a48-11f0-971e-3b18f6cdf426-0

@openshift-ci

Copy link
Copy Markdown
Contributor

@hongkailiu: This PR was included in a payload test run from #30296
trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/7f025ef0-9a48-11f0-971e-3b18f6cdf426-0

@hongkailiu

Copy link
Copy Markdown
MemberAuthor

The last job failed too earlier for an irrelevant reason.
Let us rerun:

/payload-job-with-prs periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade #30296

@openshift-ci-robotopenshift-ci-robot removed the verified Signifies that the PR passed pre-merge verification criteria label Oct 24, 2025
@openshift-ciopenshift-ciBot removed the lgtm Indicates that a PR is ready to be merged. label Oct 24, 2025
@hongkailiu

Copy link
Copy Markdown
MemberAuthor

/payload-job periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

@openshift-ci

Copy link
Copy Markdown
Contributor

@hongkailiu: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

  • periodic-ci-openshift-release-master-ci-4.21-upgrade-from-stable-4.20-e2e-gcp-ovn-rt-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/622244b0-b084-11f0-8bd2-31946e34d33f-0

@openshift-trt

Copy link
Copy Markdown

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: 7d824bf

Job NameNew Test Risk
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/olm should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
(...showing 20 of 34 rows)

New tests seen in this PR at sha: 7d824bf

  • "[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/olm should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • (...showing 20 of 34 tests)

1 similar comment
@openshift-trt

Copy link
Copy Markdown

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: 7d824bf

Job NameNew Test Risk
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/olm should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
(...showing 20 of 34 rows)

New tests seen in this PR at sha: 7d824bf

  • "[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/olm should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" [Total: 1, Pass: 1, Fail: 0, Flake: 0]
  • (...showing 20 of 34 tests)

@xueqzhan

Copy link
Copy Markdown
Contributor

/approve

@openshift-ciopenshift-ciBot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Oct 24, 2025
@DavidHurta

Copy link
Copy Markdown
Contributor

/lgtm

@openshift-ciopenshift-ciBot added the lgtm Indicates that a PR is ready to be merged. label Oct 27, 2025
@openshift-ci

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: DavidHurta, hongkailiu, petr-muller, xueqzhan

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@hongkailiu

Copy link
Copy Markdown
MemberAuthor

#30296 (comment)

/verified by @hongkailiu

@openshift-ci-robotopenshift-ci-robot added the verified Signifies that the PR passed pre-merge verification criteria label Oct 27, 2025
@openshift-ci-robot

Copy link
Copy Markdown

@hongkailiu: This PR has been marked as verified by @hongkailiu.

Details

In response to this:

#30296 (comment)

/verified by @hongkailiu

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci

openshift-ciBot commented Oct 28, 2025

Copy link
Copy Markdown
Contributor

@hongkailiu: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test nameCommitDetailsRequiredRerun command
ci/prow/e2e-metal-ipi-ovn-dualstack-local-gateway5feff1flinkfalse/test e2e-metal-ipi-ovn-dualstack-local-gateway
ci/prow/e2e-aws-disruptive5feff1flinkfalse/test e2e-aws-disruptive
ci/prow/e2e-aws-ovn5feff1flinkfalse/test e2e-aws-ovn
ci/prow/e2e-metal-ipi-virtualmedia5feff1flinkfalse/test e2e-metal-ipi-virtualmedia
ci/prow/e2e-aws-ovn-kube-apiserver-rollout5feff1flinkfalse/test e2e-aws-ovn-kube-apiserver-rollout
ci/prow/e2e-metal-ipi-ovn-dualstack5feff1flinkfalse/test e2e-metal-ipi-ovn-dualstack
ci/prow/e2e-openstack-ovnd5c10bflinkfalse/test e2e-openstack-ovn
ci/prow/e2e-metal-ipi-ovnd5c10bflinkfalse/test e2e-metal-ipi-ovn
ci/prow/e2e-aws-ovn-single-node-upgraded5c10bflinkfalse/test e2e-aws-ovn-single-node-upgrade
ci/prow/e2e-aws-ovn-single-noded5c10bflinkfalse/test e2e-aws-ovn-single-node
ci/prow/e2e-aws-ovn-single-node-seriald5c10bflinkfalse/test e2e-aws-ovn-single-node-serial

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@openshift-trt

Copy link
Copy Markdown

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: 7d824bf

Job NameNew Test Risk
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/olm should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
(...showing 20 of 34 rows)

New tests seen in this PR at sha: 7d824bf

  • "[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/olm should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • (...showing 20 of 34 tests)

1 similar comment
@openshift-trt

Copy link
Copy Markdown

Risk analysis has seen new tests most likely introduced by this PR.
Please ensure that new tests meet guidelines for naming and stability.

New Test Risks for sha: 7d824bf

Job NameNew Test Risk
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/olm should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
pull-ci-openshift-origin-main-e2e-gcp-ovn-upgradeMedium - "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True"is a new test, and was only seen in one job.
(...showing 20 of 34 rows)

New tests seen in this PR at sha: 7d824bf

  • "[Monitor:legacy-cvo-invariants][bz-Bare Metal Hardware Provisioning] clusteroperator/baremetal should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cloud-controller-manager should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/cluster-autoscaler should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/control-plane-machine-set should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-api should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Compute] clusteroperator/machine-approver should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Cloud Credential Operator] clusteroperator/cloud-credential should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-DNS] clusteroperator/dns should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Etcd] clusteroperator/etcd should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Image Registry] clusteroperator/image-registry should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Insights Operator] clusteroperator/insights should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Machine Config Operator] clusteroperator/machine-config must go Progressing=True during an upgrade test" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Management Console] clusteroperator/console should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Monitoring] clusteroperator/monitoring should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Networking] clusteroperator/network should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-Node Tuning Operator] clusteroperator/node-tuning should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/marketplace should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/olm should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • "[Monitor:legacy-cvo-invariants][bz-OLM] clusteroperator/operator-lifecycle-manager-catalog should stay Progressing=False while MCO is Progressing=True" [Total: 2, Pass: 2, Fail: 0, Flake: 0]
  • (...showing 20 of 34 tests)

@openshift-ci-robot

Copy link
Copy Markdown

/retest-required

Remaining retests: 0 against base HEAD b60bbfe and 2 for PR HEAD 7d824bf in total

@openshift-merge-bot
openshift-merge-botBot merged commit e603cd9 into openshift:mainOct 28, 2025
20 checks passed
xueqzhan added a commit to xueqzhan/origin that referenced this pull request Oct 29, 2025
…eboot"
This reverts commit e603cd9, reversing
changes made to b60bbfe.
hongkailiu added a commit to hongkailiu/origin that referenced this pull request Oct 29, 2025
openshift-merge-botBot added a commit that referenced this pull request Oct 29, 2025
TRT-2386: Revert #30296 "OTA-1637: ClusterOperators should not go Progressing only for a node reboot"
hongkailiu added a commit to hongkailiu/origin that referenced this pull request Oct 29, 2025
openshift-merge-botBot added a commit that referenced this pull request Nov 2, 2025
TRT-2386: Revert "Revert "Merge pull request #30296 from hongkailiu/OTA-1637-reboot""
dhensel-rh pushed a commit to dhensel-rh/origin that referenced this pull request Dec 19, 2025
…eboot"
This reverts commit e603cd9, reversing
changes made to b60bbfe.
dhensel-rh pushed a commit to dhensel-rh/origin that referenced this pull request Dec 19, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approvedIndicates a PR has been approved by an approver from all required OWNERS files.jira/valid-referenceIndicates that this PR references a valid Jira ticket of any type.lgtmIndicates that a PR is ready to be merged.verifiedSignifies that the PR passed pre-merge verification criteria

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@hongkailiu@openshift-ci-robot@petr-muller@DavidHurta@wking@xueqzhan