Skip to content

HDDS-9381. Remove @Flaky annotations from now-stable test cases. - #5390

Merged
adoroszlai merged 6 commits into
apache:masterfrom
ArafatKhan2198:HDDS-9381
Oct 5, 2023
Merged

HDDS-9381. Remove @Flaky annotations from now-stable test cases.#5390
adoroszlai merged 6 commits into
apache:masterfrom
ArafatKhan2198:HDDS-9381

Conversation

@ArafatKhan2198

@ArafatKhan2198ArafatKhan2198 commented Oct 4, 2023

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Remove the @Flaky annotations from the test cases that have been successfully fixed and are no longer experiencing flakiness.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-9381

How was this patch tested?

I ran the Test class 300 times for each test class and ensured that there were no intermittent failures.

Class NameCI Runs
TestSCMContainerPlacementPolicyMetrics HDDS-2961https://github.com/ArafatKhan2198/ozone/actions/runs/6398416895https://github.com/ArafatKhan2198/ozone/actions/runs/6398418026https://github.com/ArafatKhan2198/ozone/actions/runs/6398419702
TestOzoneManagerHAMetadataOnly HDDS-6644https://github.com/ArafatKhan2198/ozone/actions/runs/6235727447https://github.com/ArafatKhan2198/ozone/actions/runs/6235729232
TestOzoneManagerHAMetadataOnly HDDS-6642https://github.com/ArafatKhan2198/ozone/actions/runs/6235727447https://github.com/ArafatKhan2198/ozone/actions/runs/6235729232
TestBlockOutputStreamWithFailures HDDS-1967https://github.com/ArafatKhan2198/ozone/actions/runs/6398347226https://github.com/ArafatKhan2198/ozone/actions/runs/6398357035https://github.com/ArafatKhan2198/ozone/actions/runs/6398360165
TestCloseContainerByPipeline HDDS-3263https://github.com/ArafatKhan2198/ozone/actions/runs/6377459304https://github.com/ArafatKhan2198/ozone/actions/runs/6377460878https://github.com/ArafatKhan2198/ozone/actions/runs/6377461812
TestRandomKeyGenerator HDDS-5993https://github.com/ArafatKhan2198/ozone/actions/runs/6025312941https://github.com/ArafatKhan2198/ozone/actions/runs/6028746303https://github.com/ArafatKhan2198/ozone/actions/runs/6028751338
TestRecursiveAclWithFSO HDDS-8092https://github.com/ArafatKhan2198/ozone/actions/runs/6402939616https://github.com/ArafatKhan2198/ozone/actions/runs/6402940691https://github.com/ArafatKhan2198/ozone/actions/runs/6402942430
TestOzoneFileSystem HDDS-6645https://github.com/ArafatKhan2198/ozone/actions/runs/6403238608https://github.com/ArafatKhan2198/ozone/actions/runs/6403241618https://github.com/ArafatKhan2198/ozone/actions/runs/6403245347
TestFailureHandlingByClient HDDS-7878, HDDS-7877, HDDS-3298https://github.com/ArafatKhan2198/ozone/actions/runs/6406992420https://github.com/ArafatKhan2198/ozone/actions/runs/6406994448https://github.com/ArafatKhan2198/ozone/actions/runs/6406995766https://github.com/ArafatKhan2198/ozone/actions/runs/6398395587https://github.com/ArafatKhan2198/ozone/actions/runs/6398397760https://github.com/ArafatKhan2198/ozone/actions/runs/6398399722
TestMiniOzoneCluster HDDS-6112https://github.com/ArafatKhan2198/ozone/actions/runs/6415665976https://github.com/ArafatKhan2198/ozone/actions/runs/6415667287https://github.com/ArafatKhan2198/ozone/actions/runs/6415667828
TestContainerStateMachineFailureOnRead HDDS-3294https://github.com/ArafatKhan2198/ozone/actions/runs/6407771968https://github.com/ArafatKhan2198/ozone/actions/runs/6407770619https://github.com/ArafatKhan2198/ozone/actions/runs/6407768429

@ArafatKhan2198
ArafatKhan2198 marked this pull request as draft October 4, 2023 07:16
@adoroszlaiadoroszlai changed the title HDDS-9381 Remove "@flaky" annotations from now-stable test cases.HDDS-9381. Remove @Flaky annotations from now-stable test cases.Oct 4, 2023
@adoroszlai

Copy link
Copy Markdown
Contributor

Thanks @ArafatKhan2198 for working on this. Please link the repeated runs for each test class in this PR.

@ArafatKhan2198

Copy link
Copy Markdown
ContributorAuthor

Thanks @ArafatKhan2198 for working on this. Please link the repeated runs for each test class in this PR.

Just finalising the list, will post it shortly.

@ArafatKhan2198
ArafatKhan2198 marked this pull request as ready for review October 4, 2023 08:22
@ayushtkn

Copy link
Copy Markdown
Member

@adoroszlai

Copy link
Copy Markdown
Contributor

These aren't passing, or Am I checking it wrong?
TestOzoneFileSystem

@ayushtkn You are right, TestOzoneFileSystem has failures. Note that:

  1. failure in testListStatusOnKeyNameContainDelimiter is being fixed in HDDS-8877. Intermittent failure in TestOzoneFileSystem#testListStatusOnKeyNameContainDelimiter #5093, and does not have @Flaky annotation
  2. failure in testTrash was already fixed and @Flaky annotation was removed in HDDS-6645. Intermittent timeout in TestOzoneFileSystem#testTrash. #5330, but the repeated run's code preceded that change
  3. @Flaky does not even work for TestOzoneFileSystem since it's a JUnit4-based test class

So basically the part of this PR related to TestOzoneFileSystem can be ignored, the same change is already on master.

@ayushtknayushtkn left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should be cool then.
Thanx @adoroszlai for the details :-)

@ArafatKhan2198

Copy link
Copy Markdown
ContributorAuthor

@adoroszlai I have updated the list for the final time, I believe we should merge it !!

@adoroszlai
adoroszlai merged commit 64b6291 into apache:masterOct 5, 2023
@adoroszlai

Copy link
Copy Markdown
Contributor

Thanks @ArafatKhan2198 for testing these and the patch, @ayushtkn for the review.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@ArafatKhan2198@adoroszlai@ayushtkn