Uh oh!
There was an error while loading. Please reload this page.
test: fix flaky wpt/test-timers - #37691
Conversation
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
benjamingr
commented
Mar 10, 2021
I don't understand this well enough to review but just wanted to say thanks for all the work on these tasks 🙇 |
nodejs-github-bot
commented
Mar 10, 2021
nodejs-github-bot
commented
Mar 11, 2021
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
This comment has been minimized.
targos
commented
Mar 11, 2021
Feel free to skip the tests again in the mean time |
Trott
commented
Mar 11, 2021
The test that fails ( setup({single_test: true});setTimeout(done,-100);setTimeout(assert_unreached,10);While the ordering may be guaranteed in browsers, I don't think it is in Node.js due to the linked list stuff that underpins timers. But maybe I'm confused. /ping @nodejs/timers for confirmation. If the ordering in the above case is not in fact guaranteed in Node.js, then skipping the test is certainly the right thing to do. |
@Trott I think that there's something wrong with done(). Rewriting the test to the following is not flaky on my machine (while the original is): setup({single_test: true});setTimeout(()=>{clearTimeout(y);done();},-100);vary=setTimeout(assert_unreached,10);I assume that |
Trott
commented
Mar 13, 2021
OK. The Parallel to Simple change fixed most of them. The one it didn't fix is now marked flaky in the status file. This is ready for review. |
Stress test against this PR: https://ci.nodejs.org/view/Stress/job/node-stress-single-test/224/ ✅ |
Trott
commented
Mar 13, 2021
Stress test and CI were both green on the first run. It would be great to get this frequent-CI-failure addressed. @nodejs/testing |
Moving test harness from Parallel to Simple resolves most of the failures. negative-settimeout.any.js still needs to be marked flaky. Refs: nodejs#37672 PR-URL: nodejs#37691Fixes: nodejs#37672 Reviewed-By: Antoine du Hamel <duhamelantoine1995@gmail.com> Reviewed-By: Michaël Zasso <targos@protonmail.com>
Trott
commented
Mar 14, 2021
Landed in 66f0eb7" |
Change the wpt tests to not run in parallel in our Python test runner.
On my local machine, this changes the time needed to run the suite from
about 2 seconds to about 5 seconds, but it makes the test suite much
more reliable.
Fixes: #37672