test_runner: use run() options with isolation="none" - #62269

Closed
inukshuk wants to merge 1 commit into
nodejs:mainfrom
inukshuk:fix/test-runner-no-isolation-missing-opts
Closed

test_runner: use run() options with isolation="none"#62269
inukshuk wants to merge 1 commit into
nodejs:mainfrom
inukshuk:fix/test-runner-no-isolation-missing-opts

Conversation

@inukshuk

Copy link
Copy Markdown
Contributor

When using run() programatically with isolation="none", testNamePatterns, testSkipPatterns, and only were ignored. This combination of options only worked when set via CLI flags, because parseCommandLine() is still used to seed globalOptions.

Closes#57399

This is almost the same as #58496 which was my starting point for this. The original PR did not address only, which is equally missing. It also did not overwrite the options if they were already in globalOptions: the only way for them to be there is via parseCommandLine() above. However, I believe we need to always override them. When run() is used in code with these options, I'd always expect them to take effect and this is also what already happens with isolation="process", which forward the run() options to the child process not the CLI ones.

This also uses a fixture for running the tests as was requested in the original PR.

The test spawns a child process, because running a test within the currently running test without isolation is problematic (tests would hang for me, could be related to #57394 but it's arguably not something that should be done).

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/test_runner

@nodejs-github-botnodejs-github-bot added needs-ci PRs that need a full CI run. test_runner Issues and PRs related to the test runner subsystem. labels Mar 15, 2026
@codecov

codecovBot commented Mar 16, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 90.13%. Comparing base (cf30b2e) to head (c61404d).
⚠️ Report is 63 commits behind head on main.

Additional details and impacted files
@@ Coverage Diff @@## main #62269 +/- ##
==========================================
+ Coverage 90.11% 90.13% +0.02% 
==========================================
Files 752 752 Lines 251861 251873 +12 Branches 47365 47361 -4 ==========================================
+ Hits 226955 227024 +69 + Misses 16238 16175 -63 - Partials 8668 8674 +6 
Files with missing linesCoverage Δ
lib/internal/test_runner/runner.js94.86% <100.00%> (+0.05%)⬆️

... and 31 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from 8637ae0 to 4aa5683CompareMay 15, 2026 10:39
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I rebased this on main to make sure it's still working.

For added context, I'm working with the test runner in Electron where there are substantial differences to the process model and it would be very helpful to have all the run() options available even with isolation turned off. Happy to explore this further/differently if that would be preferable.

@mcollinamcollina added the request-ci Add this label to start a Jenkins CI on a PR. label May 16, 2026
@mcollina

Copy link
Copy Markdown
Member

The commit is missing the signoff.

@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label May 16, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from 4aa5683 to c4f6220CompareMay 17, 2026 10:14
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

My apologies, it's my first PR here. I've squashed the two commits and updated the commit message

@github-actions

Copy link
Copy Markdown
Contributor

This pull request has been marked as stale due to 90 days of inactivity.
It will be automatically closed in 30 days if no further activity occurs. If this is still relevant, please leave a comment or update it to keep it open.

@github-actionsgithub-actionsBot added the stale Issues and PRs marked stale due to inactivity and scheduled for automatic closure. label Aug 16, 2026
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I think this is ready to merge. Happy to make any changes if necessary!

@jasnell

Copy link
Copy Markdown
Member

@inukshuk ... since it's been a couple months since CI was run on this and because you've pushed commit after that CI was run, can I ask you to rebase this to latest main then we'll run CI on it again.

@github-actionsgithub-actionsBot removed the stale Issues and PRs marked stale due to inactivity and scheduled for automatic closure. label Aug 18, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: nodejs#57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from c4f6220 to c61404dCompareAugust 18, 2026 08:48
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I re-based on origin/main and ran the tests again locally; force pushed the PR branch.

@atlowChemiatlowChemi added request-ci Add this label to start a Jenkins CI on a PR. author ready PRs with CI started, the required approvals, and no outstanding review comments. labels Aug 18, 2026
@github-actionsgithub-actionsBot added request-ci-failed Starting CI with the request-ci label failed and requires manual intervention. and removed request-ci Add this label to start a Jenkins CI on a PR. labels Aug 18, 2026
@github-actions

Copy link
Copy Markdown
Contributor
Failed to start CI
- Validating Jenkins credentials
✔ Jenkins credentials valid
- Querying data for job/node-test-pull-request/73491/
SyntaxError: Unexpected token '<', ..." https://github.com/nodejs/node/actions/runs/32127626402

@atlowChemiatlowChemi removed the request-ci-failed Starting CI with the request-ci label failed and requires manual intervention. label Aug 18, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

trivikr pushed a commit that referenced this pull request Aug 22, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
@trivikr

Copy link
Copy Markdown
Member

Landed in 34db39b

@trivikrtrivikr closed this Aug 22, 2026
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 27, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author readyPRs with CI started, the required approvals, and no outstanding review comments.needs-ciPRs that need a full CI run.test_runnerIssues and PRs related to the test runner subsystem.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

test runner run() ignores testNamePatterns and testSkipPatterns when isolation is "none"

8 participants

@inukshuk@nodejs-github-bot@mcollina@jasnell@trivikr@Ethan-Arrowood@pmarchini@atlowChemi
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Skip to content

test_runner: use run() options with isolation="none" - #62269

Closed
inukshuk wants to merge 1 commit into
nodejs:mainfrom
inukshuk:fix/test-runner-no-isolation-missing-opts
Closed

test_runner: use run() options with isolation="none"#62269
inukshuk wants to merge 1 commit into
nodejs:mainfrom
inukshuk:fix/test-runner-no-isolation-missing-opts

Conversation

@inukshuk

Copy link
Copy Markdown
Contributor

When using run() programatically with isolation="none", testNamePatterns, testSkipPatterns, and only were ignored. This combination of options only worked when set via CLI flags, because parseCommandLine() is still used to seed globalOptions.

Closes#57399

This is almost the same as #58496 which was my starting point for this. The original PR did not address only, which is equally missing. It also did not overwrite the options if they were already in globalOptions: the only way for them to be there is via parseCommandLine() above. However, I believe we need to always override them. When run() is used in code with these options, I'd always expect them to take effect and this is also what already happens with isolation="process", which forward the run() options to the child process not the CLI ones.

This also uses a fixture for running the tests as was requested in the original PR.

The test spawns a child process, because running a test within the currently running test without isolation is problematic (tests would hang for me, could be related to #57394 but it's arguably not something that should be done).

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/test_runner

@nodejs-github-botnodejs-github-bot added needs-ci PRs that need a full CI run. test_runner Issues and PRs related to the test runner subsystem. labels Mar 15, 2026
@codecov

codecovBot commented Mar 16, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 90.13%. Comparing base (cf30b2e) to head (c61404d).
⚠️ Report is 63 commits behind head on main.

Additional details and impacted files
@@ Coverage Diff @@## main #62269 +/- ##
==========================================
+ Coverage 90.11% 90.13% +0.02% 
==========================================
Files 752 752 Lines 251861 251873 +12 Branches 47365 47361 -4 ==========================================
+ Hits 226955 227024 +69 + Misses 16238 16175 -63 - Partials 8668 8674 +6 
Files with missing linesCoverage Δ
lib/internal/test_runner/runner.js94.86% <100.00%> (+0.05%)⬆️

... and 31 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from 8637ae0 to 4aa5683CompareMay 15, 2026 10:39
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I rebased this on main to make sure it's still working.

For added context, I'm working with the test runner in Electron where there are substantial differences to the process model and it would be very helpful to have all the run() options available even with isolation turned off. Happy to explore this further/differently if that would be preferable.

@mcollinamcollina added the request-ci Add this label to start a Jenkins CI on a PR. label May 16, 2026
@mcollina

Copy link
Copy Markdown
Member

The commit is missing the signoff.

@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label May 16, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from 4aa5683 to c4f6220CompareMay 17, 2026 10:14
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

My apologies, it's my first PR here. I've squashed the two commits and updated the commit message

@github-actions

Copy link
Copy Markdown
Contributor

This pull request has been marked as stale due to 90 days of inactivity.
It will be automatically closed in 30 days if no further activity occurs. If this is still relevant, please leave a comment or update it to keep it open.

@github-actionsgithub-actionsBot added the stale Issues and PRs marked stale due to inactivity and scheduled for automatic closure. label Aug 16, 2026
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I think this is ready to merge. Happy to make any changes if necessary!

@jasnell

Copy link
Copy Markdown
Member

@inukshuk ... since it's been a couple months since CI was run on this and because you've pushed commit after that CI was run, can I ask you to rebase this to latest main then we'll run CI on it again.

@github-actionsgithub-actionsBot removed the stale Issues and PRs marked stale due to inactivity and scheduled for automatic closure. label Aug 18, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: nodejs#57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from c4f6220 to c61404dCompareAugust 18, 2026 08:48
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I re-based on origin/main and ran the tests again locally; force pushed the PR branch.

@atlowChemiatlowChemi added request-ci Add this label to start a Jenkins CI on a PR. author ready PRs with CI started, the required approvals, and no outstanding review comments. labels Aug 18, 2026
@github-actionsgithub-actionsBot added request-ci-failed Starting CI with the request-ci label failed and requires manual intervention. and removed request-ci Add this label to start a Jenkins CI on a PR. labels Aug 18, 2026
@github-actions

Copy link
Copy Markdown
Contributor
Failed to start CI
- Validating Jenkins credentials
✔ Jenkins credentials valid
- Querying data for job/node-test-pull-request/73491/
SyntaxError: Unexpected token '<', ..." https://github.com/nodejs/node/actions/runs/32127626402

@atlowChemiatlowChemi removed the request-ci-failed Starting CI with the request-ci label failed and requires manual intervention. label Aug 18, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

trivikr pushed a commit that referenced this pull request Aug 22, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
@trivikr

Copy link
Copy Markdown
Member

Landed in 34db39b

@trivikrtrivikr closed this Aug 22, 2026
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 27, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author readyPRs with CI started, the required approvals, and no outstanding review comments.needs-ciPRs that need a full CI run.test_runnerIssues and PRs related to the test runner subsystem.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

test runner run() ignores testNamePatterns and testSkipPatterns when isolation is "none"

8 participants

@inukshuk@nodejs-github-bot@mcollina@jasnell@trivikr@Ethan-Arrowood@pmarchini@atlowChemi
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

test_runner: use run() options with isolation="none" - #62269

Closed
inukshuk wants to merge 1 commit into
nodejs:mainfrom
inukshuk:fix/test-runner-no-isolation-missing-opts
Closed

test_runner: use run() options with isolation="none"#62269
inukshuk wants to merge 1 commit into
nodejs:mainfrom
inukshuk:fix/test-runner-no-isolation-missing-opts

Conversation

@inukshuk

Copy link
Copy Markdown
Contributor

When using run() programatically with isolation="none", testNamePatterns, testSkipPatterns, and only were ignored. This combination of options only worked when set via CLI flags, because parseCommandLine() is still used to seed globalOptions.

Closes#57399

This is almost the same as #58496 which was my starting point for this. The original PR did not address only, which is equally missing. It also did not overwrite the options if they were already in globalOptions: the only way for them to be there is via parseCommandLine() above. However, I believe we need to always override them. When run() is used in code with these options, I'd always expect them to take effect and this is also what already happens with isolation="process", which forward the run() options to the child process not the CLI ones.

This also uses a fixture for running the tests as was requested in the original PR.

The test spawns a child process, because running a test within the currently running test without isolation is problematic (tests would hang for me, could be related to #57394 but it's arguably not something that should be done).

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/test_runner

@nodejs-github-botnodejs-github-bot added needs-ci PRs that need a full CI run. test_runner Issues and PRs related to the test runner subsystem. labels Mar 15, 2026
@codecov

codecovBot commented Mar 16, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 90.13%. Comparing base (cf30b2e) to head (c61404d).
⚠️ Report is 63 commits behind head on main.

Additional details and impacted files
@@ Coverage Diff @@## main #62269 +/- ##
==========================================
+ Coverage 90.11% 90.13% +0.02% 
==========================================
Files 752 752 Lines 251861 251873 +12 Branches 47365 47361 -4 ==========================================
+ Hits 226955 227024 +69 + Misses 16238 16175 -63 - Partials 8668 8674 +6 
Files with missing linesCoverage Δ
lib/internal/test_runner/runner.js94.86% <100.00%> (+0.05%)⬆️

... and 31 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from 8637ae0 to 4aa5683CompareMay 15, 2026 10:39
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I rebased this on main to make sure it's still working.

For added context, I'm working with the test runner in Electron where there are substantial differences to the process model and it would be very helpful to have all the run() options available even with isolation turned off. Happy to explore this further/differently if that would be preferable.

@mcollinamcollina added the request-ci Add this label to start a Jenkins CI on a PR. label May 16, 2026
@mcollina

Copy link
Copy Markdown
Member

The commit is missing the signoff.

@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label May 16, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from 4aa5683 to c4f6220CompareMay 17, 2026 10:14
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

My apologies, it's my first PR here. I've squashed the two commits and updated the commit message

@github-actions

Copy link
Copy Markdown
Contributor

This pull request has been marked as stale due to 90 days of inactivity.
It will be automatically closed in 30 days if no further activity occurs. If this is still relevant, please leave a comment or update it to keep it open.

@github-actionsgithub-actionsBot added the stale Issues and PRs marked stale due to inactivity and scheduled for automatic closure. label Aug 16, 2026
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I think this is ready to merge. Happy to make any changes if necessary!

@jasnell

Copy link
Copy Markdown
Member

@inukshuk ... since it's been a couple months since CI was run on this and because you've pushed commit after that CI was run, can I ask you to rebase this to latest main then we'll run CI on it again.

@github-actionsgithub-actionsBot removed the stale Issues and PRs marked stale due to inactivity and scheduled for automatic closure. label Aug 18, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: nodejs#57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from c4f6220 to c61404dCompareAugust 18, 2026 08:48
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I re-based on origin/main and ran the tests again locally; force pushed the PR branch.

@atlowChemiatlowChemi added request-ci Add this label to start a Jenkins CI on a PR. author ready PRs with CI started, the required approvals, and no outstanding review comments. labels Aug 18, 2026
@github-actionsgithub-actionsBot added request-ci-failed Starting CI with the request-ci label failed and requires manual intervention. and removed request-ci Add this label to start a Jenkins CI on a PR. labels Aug 18, 2026
@github-actions

Copy link
Copy Markdown
Contributor
Failed to start CI
- Validating Jenkins credentials
✔ Jenkins credentials valid
- Querying data for job/node-test-pull-request/73491/
SyntaxError: Unexpected token '<', ..." https://github.com/nodejs/node/actions/runs/32127626402

@atlowChemiatlowChemi removed the request-ci-failed Starting CI with the request-ci label failed and requires manual intervention. label Aug 18, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

trivikr pushed a commit that referenced this pull request Aug 22, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
@trivikr

Copy link
Copy Markdown
Member

Landed in 34db39b

@trivikrtrivikr closed this Aug 22, 2026
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 27, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author readyPRs with CI started, the required approvals, and no outstanding review comments.needs-ciPRs that need a full CI run.test_runnerIssues and PRs related to the test runner subsystem.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

test runner run() ignores testNamePatterns and testSkipPatterns when isolation is "none"

8 participants

@inukshuk@nodejs-github-bot@mcollina@jasnell@trivikr@Ethan-Arrowood@pmarchini@atlowChemi
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

test_runner: use run() options with isolation="none" - #62269

Closed
inukshuk wants to merge 1 commit into
nodejs:mainfrom
inukshuk:fix/test-runner-no-isolation-missing-opts
Closed

test_runner: use run() options with isolation="none"#62269
inukshuk wants to merge 1 commit into
nodejs:mainfrom
inukshuk:fix/test-runner-no-isolation-missing-opts

Conversation

@inukshuk

Copy link
Copy Markdown
Contributor

When using run() programatically with isolation="none", testNamePatterns, testSkipPatterns, and only were ignored. This combination of options only worked when set via CLI flags, because parseCommandLine() is still used to seed globalOptions.

Closes#57399

This is almost the same as #58496 which was my starting point for this. The original PR did not address only, which is equally missing. It also did not overwrite the options if they were already in globalOptions: the only way for them to be there is via parseCommandLine() above. However, I believe we need to always override them. When run() is used in code with these options, I'd always expect them to take effect and this is also what already happens with isolation="process", which forward the run() options to the child process not the CLI ones.

This also uses a fixture for running the tests as was requested in the original PR.

The test spawns a child process, because running a test within the currently running test without isolation is problematic (tests would hang for me, could be related to #57394 but it's arguably not something that should be done).

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/test_runner

@nodejs-github-botnodejs-github-bot added needs-ci PRs that need a full CI run. test_runner Issues and PRs related to the test runner subsystem. labels Mar 15, 2026
@codecov

codecovBot commented Mar 16, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 90.13%. Comparing base (cf30b2e) to head (c61404d).
⚠️ Report is 63 commits behind head on main.

Additional details and impacted files
@@ Coverage Diff @@## main #62269 +/- ##
==========================================
+ Coverage 90.11% 90.13% +0.02% 
==========================================
Files 752 752 Lines 251861 251873 +12 Branches 47365 47361 -4 ==========================================
+ Hits 226955 227024 +69 + Misses 16238 16175 -63 - Partials 8668 8674 +6 
Files with missing linesCoverage Δ
lib/internal/test_runner/runner.js94.86% <100.00%> (+0.05%)⬆️

... and 31 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from 8637ae0 to 4aa5683CompareMay 15, 2026 10:39
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I rebased this on main to make sure it's still working.

For added context, I'm working with the test runner in Electron where there are substantial differences to the process model and it would be very helpful to have all the run() options available even with isolation turned off. Happy to explore this further/differently if that would be preferable.

@mcollinamcollina added the request-ci Add this label to start a Jenkins CI on a PR. label May 16, 2026
@mcollina

Copy link
Copy Markdown
Member

The commit is missing the signoff.

@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label May 16, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from 4aa5683 to c4f6220CompareMay 17, 2026 10:14
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

My apologies, it's my first PR here. I've squashed the two commits and updated the commit message

@github-actions

Copy link
Copy Markdown
Contributor

This pull request has been marked as stale due to 90 days of inactivity.
It will be automatically closed in 30 days if no further activity occurs. If this is still relevant, please leave a comment or update it to keep it open.

@github-actionsgithub-actionsBot added the stale Issues and PRs marked stale due to inactivity and scheduled for automatic closure. label Aug 16, 2026
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I think this is ready to merge. Happy to make any changes if necessary!

@jasnell

Copy link
Copy Markdown
Member

@inukshuk ... since it's been a couple months since CI was run on this and because you've pushed commit after that CI was run, can I ask you to rebase this to latest main then we'll run CI on it again.

@github-actionsgithub-actionsBot removed the stale Issues and PRs marked stale due to inactivity and scheduled for automatic closure. label Aug 18, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: nodejs#57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from c4f6220 to c61404dCompareAugust 18, 2026 08:48
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I re-based on origin/main and ran the tests again locally; force pushed the PR branch.

@atlowChemiatlowChemi added request-ci Add this label to start a Jenkins CI on a PR. author ready PRs with CI started, the required approvals, and no outstanding review comments. labels Aug 18, 2026
@github-actionsgithub-actionsBot added request-ci-failed Starting CI with the request-ci label failed and requires manual intervention. and removed request-ci Add this label to start a Jenkins CI on a PR. labels Aug 18, 2026
@github-actions

Copy link
Copy Markdown
Contributor
Failed to start CI
- Validating Jenkins credentials
✔ Jenkins credentials valid
- Querying data for job/node-test-pull-request/73491/
SyntaxError: Unexpected token '<', ..." https://github.com/nodejs/node/actions/runs/32127626402

@atlowChemiatlowChemi removed the request-ci-failed Starting CI with the request-ci label failed and requires manual intervention. label Aug 18, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

trivikr pushed a commit that referenced this pull request Aug 22, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
@trivikr

Copy link
Copy Markdown
Member

Landed in 34db39b

@trivikrtrivikr closed this Aug 22, 2026
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 27, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author readyPRs with CI started, the required approvals, and no outstanding review comments.needs-ciPRs that need a full CI run.test_runnerIssues and PRs related to the test runner subsystem.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

test runner run() ignores testNamePatterns and testSkipPatterns when isolation is "none"

8 participants

@inukshuk@nodejs-github-bot@mcollina@jasnell@trivikr@Ethan-Arrowood@pmarchini@atlowChemi
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
Skip to content

test_runner: use run() options with isolation="none" - #62269

Closed
inukshuk wants to merge 1 commit into
nodejs:mainfrom
inukshuk:fix/test-runner-no-isolation-missing-opts
Closed

test_runner: use run() options with isolation="none"#62269
inukshuk wants to merge 1 commit into
nodejs:mainfrom
inukshuk:fix/test-runner-no-isolation-missing-opts

Conversation

@inukshuk

Copy link
Copy Markdown
Contributor

When using run() programatically with isolation="none", testNamePatterns, testSkipPatterns, and only were ignored. This combination of options only worked when set via CLI flags, because parseCommandLine() is still used to seed globalOptions.

Closes#57399

This is almost the same as #58496 which was my starting point for this. The original PR did not address only, which is equally missing. It also did not overwrite the options if they were already in globalOptions: the only way for them to be there is via parseCommandLine() above. However, I believe we need to always override them. When run() is used in code with these options, I'd always expect them to take effect and this is also what already happens with isolation="process", which forward the run() options to the child process not the CLI ones.

This also uses a fixture for running the tests as was requested in the original PR.

The test spawns a child process, because running a test within the currently running test without isolation is problematic (tests would hang for me, could be related to #57394 but it's arguably not something that should be done).

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/test_runner

@nodejs-github-botnodejs-github-bot added needs-ci PRs that need a full CI run. test_runner Issues and PRs related to the test runner subsystem. labels Mar 15, 2026
@codecov

codecovBot commented Mar 16, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 90.13%. Comparing base (cf30b2e) to head (c61404d).
⚠️ Report is 63 commits behind head on main.

Additional details and impacted files
@@ Coverage Diff @@## main #62269 +/- ##
==========================================
+ Coverage 90.11% 90.13% +0.02% 
==========================================
Files 752 752 Lines 251861 251873 +12 Branches 47365 47361 -4 ==========================================
+ Hits 226955 227024 +69 + Misses 16238 16175 -63 - Partials 8668 8674 +6 
Files with missing linesCoverage Δ
lib/internal/test_runner/runner.js94.86% <100.00%> (+0.05%)⬆️

... and 31 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from 8637ae0 to 4aa5683CompareMay 15, 2026 10:39
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I rebased this on main to make sure it's still working.

For added context, I'm working with the test runner in Electron where there are substantial differences to the process model and it would be very helpful to have all the run() options available even with isolation turned off. Happy to explore this further/differently if that would be preferable.

@mcollinamcollina added the request-ci Add this label to start a Jenkins CI on a PR. label May 16, 2026
@mcollina

Copy link
Copy Markdown
Member

The commit is missing the signoff.

@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label May 16, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from 4aa5683 to c4f6220CompareMay 17, 2026 10:14
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

My apologies, it's my first PR here. I've squashed the two commits and updated the commit message

@github-actions

Copy link
Copy Markdown
Contributor

This pull request has been marked as stale due to 90 days of inactivity.
It will be automatically closed in 30 days if no further activity occurs. If this is still relevant, please leave a comment or update it to keep it open.

@github-actionsgithub-actionsBot added the stale Issues and PRs marked stale due to inactivity and scheduled for automatic closure. label Aug 16, 2026
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I think this is ready to merge. Happy to make any changes if necessary!

@jasnell

Copy link
Copy Markdown
Member

@inukshuk ... since it's been a couple months since CI was run on this and because you've pushed commit after that CI was run, can I ask you to rebase this to latest main then we'll run CI on it again.

@github-actionsgithub-actionsBot removed the stale Issues and PRs marked stale due to inactivity and scheduled for automatic closure. label Aug 18, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: nodejs#57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from c4f6220 to c61404dCompareAugust 18, 2026 08:48
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I re-based on origin/main and ran the tests again locally; force pushed the PR branch.

@atlowChemiatlowChemi added request-ci Add this label to start a Jenkins CI on a PR. author ready PRs with CI started, the required approvals, and no outstanding review comments. labels Aug 18, 2026
@github-actionsgithub-actionsBot added request-ci-failed Starting CI with the request-ci label failed and requires manual intervention. and removed request-ci Add this label to start a Jenkins CI on a PR. labels Aug 18, 2026
@github-actions

Copy link
Copy Markdown
Contributor
Failed to start CI
- Validating Jenkins credentials
✔ Jenkins credentials valid
- Querying data for job/node-test-pull-request/73491/
SyntaxError: Unexpected token '<', ..." https://github.com/nodejs/node/actions/runs/32127626402

@atlowChemiatlowChemi removed the request-ci-failed Starting CI with the request-ci label failed and requires manual intervention. label Aug 18, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

trivikr pushed a commit that referenced this pull request Aug 22, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
@trivikr

Copy link
Copy Markdown
Member

Landed in 34db39b

@trivikrtrivikr closed this Aug 22, 2026
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 27, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author readyPRs with CI started, the required approvals, and no outstanding review comments.needs-ciPRs that need a full CI run.test_runnerIssues and PRs related to the test runner subsystem.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

test runner run() ignores testNamePatterns and testSkipPatterns when isolation is "none"

8 participants

@inukshuk@nodejs-github-bot@mcollina@jasnell@trivikr@Ethan-Arrowood@pmarchini@atlowChemi
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

test_runner: use run() options with isolation="none" - #62269

Closed
inukshuk wants to merge 1 commit into
nodejs:mainfrom
inukshuk:fix/test-runner-no-isolation-missing-opts
Closed

test_runner: use run() options with isolation="none"#62269
inukshuk wants to merge 1 commit into
nodejs:mainfrom
inukshuk:fix/test-runner-no-isolation-missing-opts

Conversation

@inukshuk

Copy link
Copy Markdown
Contributor

When using run() programatically with isolation="none", testNamePatterns, testSkipPatterns, and only were ignored. This combination of options only worked when set via CLI flags, because parseCommandLine() is still used to seed globalOptions.

Closes#57399

This is almost the same as #58496 which was my starting point for this. The original PR did not address only, which is equally missing. It also did not overwrite the options if they were already in globalOptions: the only way for them to be there is via parseCommandLine() above. However, I believe we need to always override them. When run() is used in code with these options, I'd always expect them to take effect and this is also what already happens with isolation="process", which forward the run() options to the child process not the CLI ones.

This also uses a fixture for running the tests as was requested in the original PR.

The test spawns a child process, because running a test within the currently running test without isolation is problematic (tests would hang for me, could be related to #57394 but it's arguably not something that should be done).

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/test_runner

@nodejs-github-botnodejs-github-bot added needs-ci PRs that need a full CI run. test_runner Issues and PRs related to the test runner subsystem. labels Mar 15, 2026
@codecov

codecovBot commented Mar 16, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 90.13%. Comparing base (cf30b2e) to head (c61404d).
⚠️ Report is 63 commits behind head on main.

Additional details and impacted files
@@ Coverage Diff @@## main #62269 +/- ##
==========================================
+ Coverage 90.11% 90.13% +0.02% 
==========================================
Files 752 752 Lines 251861 251873 +12 Branches 47365 47361 -4 ==========================================
+ Hits 226955 227024 +69 + Misses 16238 16175 -63 - Partials 8668 8674 +6 
Files with missing linesCoverage Δ
lib/internal/test_runner/runner.js94.86% <100.00%> (+0.05%)⬆️

... and 31 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from 8637ae0 to 4aa5683CompareMay 15, 2026 10:39
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I rebased this on main to make sure it's still working.

For added context, I'm working with the test runner in Electron where there are substantial differences to the process model and it would be very helpful to have all the run() options available even with isolation turned off. Happy to explore this further/differently if that would be preferable.

@mcollinamcollina added the request-ci Add this label to start a Jenkins CI on a PR. label May 16, 2026
@mcollina

Copy link
Copy Markdown
Member

The commit is missing the signoff.

@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label May 16, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from 4aa5683 to c4f6220CompareMay 17, 2026 10:14
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

My apologies, it's my first PR here. I've squashed the two commits and updated the commit message

@github-actions

Copy link
Copy Markdown
Contributor

This pull request has been marked as stale due to 90 days of inactivity.
It will be automatically closed in 30 days if no further activity occurs. If this is still relevant, please leave a comment or update it to keep it open.

@github-actionsgithub-actionsBot added the stale Issues and PRs marked stale due to inactivity and scheduled for automatic closure. label Aug 16, 2026
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I think this is ready to merge. Happy to make any changes if necessary!

@jasnell

Copy link
Copy Markdown
Member

@inukshuk ... since it's been a couple months since CI was run on this and because you've pushed commit after that CI was run, can I ask you to rebase this to latest main then we'll run CI on it again.

@github-actionsgithub-actionsBot removed the stale Issues and PRs marked stale due to inactivity and scheduled for automatic closure. label Aug 18, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: nodejs#57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from c4f6220 to c61404dCompareAugust 18, 2026 08:48
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I re-based on origin/main and ran the tests again locally; force pushed the PR branch.

@atlowChemiatlowChemi added request-ci Add this label to start a Jenkins CI on a PR. author ready PRs with CI started, the required approvals, and no outstanding review comments. labels Aug 18, 2026
@github-actionsgithub-actionsBot added request-ci-failed Starting CI with the request-ci label failed and requires manual intervention. and removed request-ci Add this label to start a Jenkins CI on a PR. labels Aug 18, 2026
@github-actions

Copy link
Copy Markdown
Contributor
Failed to start CI
- Validating Jenkins credentials
✔ Jenkins credentials valid
- Querying data for job/node-test-pull-request/73491/
SyntaxError: Unexpected token '<', ..." https://github.com/nodejs/node/actions/runs/32127626402

@atlowChemiatlowChemi removed the request-ci-failed Starting CI with the request-ci label failed and requires manual intervention. label Aug 18, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

trivikr pushed a commit that referenced this pull request Aug 22, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
@trivikr

Copy link
Copy Markdown
Member

Landed in 34db39b

@trivikrtrivikr closed this Aug 22, 2026
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 27, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author readyPRs with CI started, the required approvals, and no outstanding review comments.needs-ciPRs that need a full CI run.test_runnerIssues and PRs related to the test runner subsystem.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

test runner run() ignores testNamePatterns and testSkipPatterns when isolation is "none"

8 participants

@inukshuk@nodejs-github-bot@mcollina@jasnell@trivikr@Ethan-Arrowood@pmarchini@atlowChemi
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

test_runner: use run() options with isolation="none" - #62269

Closed
inukshuk wants to merge 1 commit into
nodejs:mainfrom
inukshuk:fix/test-runner-no-isolation-missing-opts
Closed

test_runner: use run() options with isolation="none"#62269
inukshuk wants to merge 1 commit into
nodejs:mainfrom
inukshuk:fix/test-runner-no-isolation-missing-opts

Conversation

@inukshuk

Copy link
Copy Markdown
Contributor

When using run() programatically with isolation="none", testNamePatterns, testSkipPatterns, and only were ignored. This combination of options only worked when set via CLI flags, because parseCommandLine() is still used to seed globalOptions.

Closes#57399

This is almost the same as #58496 which was my starting point for this. The original PR did not address only, which is equally missing. It also did not overwrite the options if they were already in globalOptions: the only way for them to be there is via parseCommandLine() above. However, I believe we need to always override them. When run() is used in code with these options, I'd always expect them to take effect and this is also what already happens with isolation="process", which forward the run() options to the child process not the CLI ones.

This also uses a fixture for running the tests as was requested in the original PR.

The test spawns a child process, because running a test within the currently running test without isolation is problematic (tests would hang for me, could be related to #57394 but it's arguably not something that should be done).

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/test_runner

@nodejs-github-botnodejs-github-bot added needs-ci PRs that need a full CI run. test_runner Issues and PRs related to the test runner subsystem. labels Mar 15, 2026
@codecov

codecovBot commented Mar 16, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 90.13%. Comparing base (cf30b2e) to head (c61404d).
⚠️ Report is 63 commits behind head on main.

Additional details and impacted files
@@ Coverage Diff @@## main #62269 +/- ##
==========================================
+ Coverage 90.11% 90.13% +0.02% 
==========================================
Files 752 752 Lines 251861 251873 +12 Branches 47365 47361 -4 ==========================================
+ Hits 226955 227024 +69 + Misses 16238 16175 -63 - Partials 8668 8674 +6 
Files with missing linesCoverage Δ
lib/internal/test_runner/runner.js94.86% <100.00%> (+0.05%)⬆️

... and 31 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from 8637ae0 to 4aa5683CompareMay 15, 2026 10:39
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I rebased this on main to make sure it's still working.

For added context, I'm working with the test runner in Electron where there are substantial differences to the process model and it would be very helpful to have all the run() options available even with isolation turned off. Happy to explore this further/differently if that would be preferable.

@mcollinamcollina added the request-ci Add this label to start a Jenkins CI on a PR. label May 16, 2026
@mcollina

Copy link
Copy Markdown
Member

The commit is missing the signoff.

@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label May 16, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from 4aa5683 to c4f6220CompareMay 17, 2026 10:14
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

My apologies, it's my first PR here. I've squashed the two commits and updated the commit message

@github-actions

Copy link
Copy Markdown
Contributor

This pull request has been marked as stale due to 90 days of inactivity.
It will be automatically closed in 30 days if no further activity occurs. If this is still relevant, please leave a comment or update it to keep it open.

@github-actionsgithub-actionsBot added the stale Issues and PRs marked stale due to inactivity and scheduled for automatic closure. label Aug 16, 2026
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I think this is ready to merge. Happy to make any changes if necessary!

@jasnell

Copy link
Copy Markdown
Member

@inukshuk ... since it's been a couple months since CI was run on this and because you've pushed commit after that CI was run, can I ask you to rebase this to latest main then we'll run CI on it again.

@github-actionsgithub-actionsBot removed the stale Issues and PRs marked stale due to inactivity and scheduled for automatic closure. label Aug 18, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: nodejs#57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from c4f6220 to c61404dCompareAugust 18, 2026 08:48
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I re-based on origin/main and ran the tests again locally; force pushed the PR branch.

@atlowChemiatlowChemi added request-ci Add this label to start a Jenkins CI on a PR. author ready PRs with CI started, the required approvals, and no outstanding review comments. labels Aug 18, 2026
@github-actionsgithub-actionsBot added request-ci-failed Starting CI with the request-ci label failed and requires manual intervention. and removed request-ci Add this label to start a Jenkins CI on a PR. labels Aug 18, 2026
@github-actions

Copy link
Copy Markdown
Contributor
Failed to start CI
- Validating Jenkins credentials
✔ Jenkins credentials valid
- Querying data for job/node-test-pull-request/73491/
SyntaxError: Unexpected token '<', ..." https://github.com/nodejs/node/actions/runs/32127626402

@atlowChemiatlowChemi removed the request-ci-failed Starting CI with the request-ci label failed and requires manual intervention. label Aug 18, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

trivikr pushed a commit that referenced this pull request Aug 22, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
@trivikr

Copy link
Copy Markdown
Member

Landed in 34db39b

@trivikrtrivikr closed this Aug 22, 2026
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 27, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author readyPRs with CI started, the required approvals, and no outstanding review comments.needs-ciPRs that need a full CI run.test_runnerIssues and PRs related to the test runner subsystem.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

test runner run() ignores testNamePatterns and testSkipPatterns when isolation is "none"

8 participants

@inukshuk@nodejs-github-bot@mcollina@jasnell@trivikr@Ethan-Arrowood@pmarchini@atlowChemi
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
Skip to content

test_runner: use run() options with isolation="none" - #62269

Closed
inukshuk wants to merge 1 commit into
nodejs:mainfrom
inukshuk:fix/test-runner-no-isolation-missing-opts
Closed

test_runner: use run() options with isolation="none"#62269
inukshuk wants to merge 1 commit into
nodejs:mainfrom
inukshuk:fix/test-runner-no-isolation-missing-opts

Conversation

@inukshuk

Copy link
Copy Markdown
Contributor

When using run() programatically with isolation="none", testNamePatterns, testSkipPatterns, and only were ignored. This combination of options only worked when set via CLI flags, because parseCommandLine() is still used to seed globalOptions.

Closes#57399

This is almost the same as #58496 which was my starting point for this. The original PR did not address only, which is equally missing. It also did not overwrite the options if they were already in globalOptions: the only way for them to be there is via parseCommandLine() above. However, I believe we need to always override them. When run() is used in code with these options, I'd always expect them to take effect and this is also what already happens with isolation="process", which forward the run() options to the child process not the CLI ones.

This also uses a fixture for running the tests as was requested in the original PR.

The test spawns a child process, because running a test within the currently running test without isolation is problematic (tests would hang for me, could be related to #57394 but it's arguably not something that should be done).

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/test_runner

@nodejs-github-botnodejs-github-bot added needs-ci PRs that need a full CI run. test_runner Issues and PRs related to the test runner subsystem. labels Mar 15, 2026
@codecov

codecovBot commented Mar 16, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 90.13%. Comparing base (cf30b2e) to head (c61404d).
⚠️ Report is 63 commits behind head on main.

Additional details and impacted files
@@ Coverage Diff @@## main #62269 +/- ##
==========================================
+ Coverage 90.11% 90.13% +0.02% 
==========================================
Files 752 752 Lines 251861 251873 +12 Branches 47365 47361 -4 ==========================================
+ Hits 226955 227024 +69 + Misses 16238 16175 -63 - Partials 8668 8674 +6 
Files with missing linesCoverage Δ
lib/internal/test_runner/runner.js94.86% <100.00%> (+0.05%)⬆️

... and 31 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from 8637ae0 to 4aa5683CompareMay 15, 2026 10:39
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I rebased this on main to make sure it's still working.

For added context, I'm working with the test runner in Electron where there are substantial differences to the process model and it would be very helpful to have all the run() options available even with isolation turned off. Happy to explore this further/differently if that would be preferable.

@mcollinamcollina added the request-ci Add this label to start a Jenkins CI on a PR. label May 16, 2026
@mcollina

Copy link
Copy Markdown
Member

The commit is missing the signoff.

@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label May 16, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from 4aa5683 to c4f6220CompareMay 17, 2026 10:14
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

My apologies, it's my first PR here. I've squashed the two commits and updated the commit message

@github-actions

Copy link
Copy Markdown
Contributor

This pull request has been marked as stale due to 90 days of inactivity.
It will be automatically closed in 30 days if no further activity occurs. If this is still relevant, please leave a comment or update it to keep it open.

@github-actionsgithub-actionsBot added the stale Issues and PRs marked stale due to inactivity and scheduled for automatic closure. label Aug 16, 2026
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I think this is ready to merge. Happy to make any changes if necessary!

@jasnell

Copy link
Copy Markdown
Member

@inukshuk ... since it's been a couple months since CI was run on this and because you've pushed commit after that CI was run, can I ask you to rebase this to latest main then we'll run CI on it again.

@github-actionsgithub-actionsBot removed the stale Issues and PRs marked stale due to inactivity and scheduled for automatic closure. label Aug 18, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: nodejs#57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
@inukshuk
inukshukforce-pushed the fix/test-runner-no-isolation-missing-opts branch from c4f6220 to c61404dCompareAugust 18, 2026 08:48
@inukshuk

Copy link
Copy Markdown
ContributorAuthor

I re-based on origin/main and ran the tests again locally; force pushed the PR branch.

@atlowChemiatlowChemi added request-ci Add this label to start a Jenkins CI on a PR. author ready PRs with CI started, the required approvals, and no outstanding review comments. labels Aug 18, 2026
@github-actionsgithub-actionsBot added request-ci-failed Starting CI with the request-ci label failed and requires manual intervention. and removed request-ci Add this label to start a Jenkins CI on a PR. labels Aug 18, 2026
@github-actions

Copy link
Copy Markdown
Contributor
Failed to start CI
- Validating Jenkins credentials
✔ Jenkins credentials valid
- Querying data for job/node-test-pull-request/73491/
SyntaxError: Unexpected token '<', ..." https://github.com/nodejs/node/actions/runs/32127626402

@atlowChemiatlowChemi removed the request-ci-failed Starting CI with the request-ci label failed and requires manual intervention. label Aug 18, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

trivikr pushed a commit that referenced this pull request Aug 22, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
@trivikr

Copy link
Copy Markdown
Member

Landed in 34db39b

@trivikrtrivikr closed this Aug 22, 2026
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 27, 2026
When using run() programatically with isolation="none",
testNamePatterns, testSkipPattersn, and only were ignored.
This combination of options only worked when set via CLI flags,
because parseCommandLine() is still used to seed globalOptions.
Fixes: #57399
Signed-off-by: Sylvester Keil <sylvester@keil.or.at>
PR-URL: #62269
Reviewed-By: Ethan Arrowood <ethan@arrowood.dev>
Reviewed-By: Chemi Atlow <chemi@atlow.co.il>
Reviewed-By: Pietro Marchini <pietro.marchini94@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author readyPRs with CI started, the required approvals, and no outstanding review comments.needs-ciPRs that need a full CI run.test_runnerIssues and PRs related to the test runner subsystem.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

test runner run() ignores testNamePatterns and testSkipPatterns when isolation is "none"

8 participants

@inukshuk@nodejs-github-bot@mcollina@jasnell@trivikr@Ethan-Arrowood@pmarchini@atlowChemi