Skip to content

Fix parallel test runner: all 10 suites, instance-per-suite - #8

Merged
JC-000 merged 2 commits into
masterfrom
fix/parallel-test-runner
May 6, 2026
Merged

Fix parallel test runner: all 10 suites, instance-per-suite#8
JC-000 merged 2 commits into
masterfrom
fix/parallel-test-runner

Conversation

@JC-000

Copy link
Copy Markdown
Owner

Summary

  • Fixed as_completed bug — futures added mid-iteration were never collected, so only the first 3 of 5 suites appeared in results
  • Added all 10 test suites to the parallel runner (was 5): net, sha256, crypto, hkdf, tls_record, tls_handshake, keyschedule, entropy, http, x509
  • Instance-per-suite — each suite gets a fresh VICE instance via ViceInstanceManager.acquire(), avoiding C64 state contamination that caused HKDF to fail 0/12 on reused workers
  • Added --skip-slow flag to skip x509/ECDSA (~5s vs ~5min wall time)
  • Added --seed flag for reproducible random test vectors
  • 193/193 tests pass across all 10 suites

Test plan

  • python3 tools/run_all_tests.py --skip-slow — 182/182 pass (~5s)
  • python3 tools/run_all_tests.py — 193/193 pass (~5min, ECDSA verify)
  • All 11 individual test files pass standalone

🤖 Generated with Claude Code


Originally posted by @JC-000 on 2026-03-29

JC-000and others added 2 commits March 23, 2026 15:39
…erged
The harness wait_for_text() now calls transport.resume() between polls
internally, so the inline polling loops are no longer needed. This
replaces 13 copies of the same ~10-line loop with single wait_for_text()
calls, reducing total code by 120 lines.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
…r reuse
The parallel runner had two bugs: (1) as_completed() didn't see futures added
mid-iteration, so only the first N suites were collected, and (2) reusing VICE
instances across suites caused state contamination (HKDF 0/12 on reused workers).
Fix: allocate a fresh VICE instance per suite via run_suite_in_own_instance().
Add all 10 suites (was 5). Add --skip-slow and --seed flags. 193/193 pass.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@JC-000
JC-000 merged commit a3cad65 into masterMay 6, 2026
@JC-000
JC-000 deleted the fix/parallel-test-runner branch May 6, 2026 19:03
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@JC-000