Skip to content

Attempting to increase reliability of some Pester tests - take 2 - #268

Merged
Howard Wolosky (HowardWolosky) merged 1 commit into
microsoft:masterfrom
HowardWolosky:reliability2
Jul 19, 2020
Merged

Attempting to increase reliability of some Pester tests - take 2#268
Howard Wolosky (HowardWolosky) merged 1 commit into
microsoft:masterfrom
HowardWolosky:reliability2

Conversation

@HowardWolosky

@HowardWoloskyHoward Wolosky (HowardWolosky) commented Jul 19, 2020

Copy link
Copy Markdown
Contributor

Description

This is re-implementing #265 in a more robust way, thanks to a suggestion from Simon Heather (@X-Guardian) in #267.

Instead of adding in one-off sleeps throughout the test codebase, there is now a new configuration value (StateChangeDelaySeconds) that will allow us to insert a delay before returning the result of any state change request.

This should ideally consistently add reliability throughout the entire test codebase.

Issues Fixed

Fixes#264

References

n/a

Checklist

  • You actually ran the code that you just wrote, especially if you did just "one last quick change".
  • Comment-based help added/updated, including examples.
  • Static analysis is reporting back clean.
  • New/changed code adheres to our coding guidelines.
  • Formatters were created for any new types being added.
  • New/changed code continues to support the pipeline.
  • Changes to the manifest file follow the manifest guidance.
  • Unit tests were added/updated and are all passing. See testing guidelines. This includes making sure that all pipeline input variations have been covered.
  • Relevant usage examples have been added/updated in USAGE.md.
  • If desired, ensure your name is added to our Contributors list

This is re-implementing microsoft#265 in a more robust way, thanks to a
suggestion from @X-Guardian.
Instead of adding in one-off sleeps throughout the test codebase,
there is now a new configuration value that will allow us to insert
a delay before returning the result of _any_ state change request.
This should ideally consistently add reliability throughout the entire
test codebase.
@HowardWoloskyHoward Wolosky (HowardWolosky) added the tests A change related to the Pester tests for the module. label Jul 19, 2020
@HowardWolosky

Copy link
Copy Markdown
ContributorAuthor

/azp run PowerShellForGitHub-CI

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 1 pipeline(s).

@HowardWolosky
Howard Wolosky (HowardWolosky) merged commit 402529a into microsoft:masterJul 19, 2020
@HowardWolosky
Howard Wolosky (HowardWolosky) deleted the reliability2 branch July 19, 2020 18:35
Howard Wolosky (HowardWolosky) added a commit to HowardWolosky/PowerShellForGitHub that referenced this pull request Jul 19, 2020
Howard Wolosky (HowardWolosky) added a commit to HowardWolosky/PowerShellForGitHub that referenced this pull request Jul 20, 2020
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

testsA change related to the Pester tests for the module.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Investigate and fix instability in tests

1 participant

@HowardWolosky