http: use intrusive lists in ConnectionsList - #65296

Merged
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
mcollina:http-connectionslist-intrusive
Aug 23, 2026
Merged

http: use intrusive lists in ConnectionsList#65296
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
mcollina:http-connectionslist-intrusive

Conversation

@mcollina

@mcollinamcollina commented Aug 15, 2026

Copy link
Copy Markdown
Member

Every HTTP message was performing multiple erase and insert operations on the two std::set instances in ConnectionsList, which are ordered by a key (last_message_start_) that mutates on every message. In a hello-world server profile this showed up as ~2.2% of total CPU cycles spent in red-black tree rebalancing plus tree-node allocations, all on the per-request hot path.

This PR replaces both sets with intrusive doubly-linked lists:

  • A node is linked to itself when it is not in a list, so Remove() is idempotent and the destructor unlinks automatically, which also removes the old "Pop from the lists BEFORE resetting last_message_start_" footgun.
  • Membership in the "all connections" list no longer changes per message, so the Pop+Push pair in on_message_begin/on_message_complete is gone entirely.
  • Updating the active list is now a single O(1) unlink + tail append with no allocations.
  • Appending to the tail keeps the active list ordered by last_message_start_ because uv_hrtime() is monotonic, so expired() semantics are unchanged. The arrays returned by all()/idle()/active() are now in insertion order instead of comparator order; none of their consumers depend on ordering.

Benchmark results (Linux, i7-7700, server and benchmarker pinned to separate cores):

 confidence improvement accuracy (*) (**) (***)
http/simple.js duration=5 chunkedEnc=0 c=50 chunks=1 len=4 type='bytes' benchmarker='wrk' ** 4.06 % ±2.41% ±3.23% ±4.25%
http/simple.js duration=5 chunkedEnc=0 c=500 chunks=1 len=4 type='bytes' benchmarker='wrk' 2.35 % ±2.45% ±3.29% ±4.34%

A separate interleaved wrk A/B (hello-world server, -t2 -c50, 5 alternating pairs) shows +4.9% (26,599 → 27,914 req/s), with the patched binary winning every pair. A perf profile of the patched binary confirms the _Rb_tree symbols are gone and malloc traffic in the parser path is roughly halved.

This PR was prepared with the help of AI assistance.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/http
  • @nodejs/net

@nodejs-github-botnodejs-github-bot added c++ Issues and PRs that require attention from people who are familiar with C++. http_parser Issues and PRs related to the HTTP parser implementation or http_parser binding. needs-ci PRs that need a full CI run. labels Aug 15, 2026
@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from e7c6580 to 41044a2CompareAugust 15, 2026 04:07
@codecov

codecovBot commented Aug 15, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 86.27451% with 7 lines in your changes missing coverage. Please review.
✅ Project coverage is 90.12%. Comparing base (347e266) to head (0cc64e0).
⚠️ Report is 269 commits behind head on main.

Files with missing linesPatch %Lines
src/node_http_parser.cc86.27%7 Missing ⚠️
Additional details and impacted files
@@ Coverage Diff @@## main #65296 +/- ##
==========================================
- Coverage 90.30% 90.12% -0.19% 
==========================================
Files 759 752 -7 Lines 248294 251826 +3532 Branches 46860 47356 +496 ==========================================
+ Hits 224220 226954 +2734 - Misses 15516 16225 +709 - Partials 8558 8647 +89 
Files with missing linesCoverage Δ
src/node_http_parser.cc84.72% <86.27%> (-0.26%)⬇️

... and 174 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@ronagronag left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have you benchmarked against an unordered_set or just a plain vector?

I suspect those would be more cache friendly and avoid pointer chasing.

@ronagronag added author ready PRs with CI started, the required approvals, and no outstanding review comments. request-ci Add this label to start a Jenkins CI on a PR. labels Aug 16, 2026
@ronag
ronag requested a review from jasnellAugust 16, 2026 07:59
@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 16, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as outdated.

@ronagronag added the commit-queue PRs queued for automated landing through the Commit Queue. label Aug 17, 2026
@nodejs-github-botnodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Aug 17, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/65296
✔ Done loading data for nodejs/node/pull/65296
----------------------------------- PR info ------------------------------------
Title http: use intrusive lists in ConnectionsList (#65296)
Author Matteo Collina <matteo.collina@gmail.com> (@mcollina)
Branch mcollina:http-connectionslist-intrusive -> nodejs:main
Labels c++, http_parser, author ready, needs-ci, commit-queue
Commits 1
- http: use intrusive lists in ConnectionsList
Committers 1
- Matteo Collina <hello@matteocollina.com>
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
--------------------------------------------------------------------------------
ℹ This PR was created on Sat, 15 Aug 2026 04:05:15 GMT
✔ Approvals: 2
✔ - Robert Nagy (@ronag) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4943029706
✔ - Paolo Insogna (@ShogunPanda) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4949195971
✘ 3 GitHub CI job(s) failed:
✘ - format-cpp: FAILURE (https://github.com/nodejs/node/actions/runs/31863623606/job/94961040997)
✘ - lint-commit-message: FAILURE (https://github.com/nodejs/node/actions/runs/31863623617/job/94961006361)
✘ - test-macOS: FAILURE (https://github.com/nodejs/node/actions/runs/31863623630/job/94961038864)
ℹ Last Full PR CI on 2026-08-16T15:24:03Z: https://ci.nodejs.org/job/node-test-pull-request/75886/
- Querying data for job/node-test-pull-request/75886/
✔ Build data downloaded
- Querying failures of job/node-test-commit/90616/
✔ Data downloaded
✘ 2 failure(s) on the last Jenkins CI run
--------------------------------------------------------------------------------
✔ Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/32009841931

@nodejs-github-bot

This comment was marked as outdated.

@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from 41044a2 to 340ded7CompareAugust 17, 2026 15:45
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from 340ded7 to 0cc64e0CompareAugust 17, 2026 16:16
@ronagronag added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Aug 19, 2026
@nodejs-github-botnodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Aug 19, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/65296
✔ Done loading data for nodejs/node/pull/65296
----------------------------------- PR info ------------------------------------
Title http: use intrusive lists in ConnectionsList (#65296)
Author Matteo Collina <matteo.collina@gmail.com> (@mcollina)
Branch mcollina:http-connectionslist-intrusive -> nodejs:main
Labels c++, http_parser, author ready, needs-ci, commit-queue
Commits 1
- http: use intrusive lists in ConnectionsList
Committers 1
- Matteo Collina <hello@matteocollina.com>
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
--------------------------------------------------------------------------------
ℹ This PR was created on Sat, 15 Aug 2026 04:05:15 GMT
✔ Approvals: 3
✔ - Robert Nagy (@ronag) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4943029706
✔ - Paolo Insogna (@ShogunPanda) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4969028193
✔ - James M Snell (@jasnell) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4951932271
✔ Last GitHub CI successful
ℹ Last Full PR CI on 2026-08-17T08:31:16Z: https://ci.nodejs.org/job/node-test-pull-request/75919/
⚠ Commits were pushed after the last Full PR CI run:
⚠ - http: use intrusive lists in ConnectionsList
- Querying data for job/node-test-pull-request/75919/
✔ Build data downloaded
✔ Last Jenkins CI successful
--------------------------------------------------------------------------------
✔ Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/32254812825

@mcollinamcollina added the request-ci Add this label to start a Jenkins CI on a PR. label Aug 19, 2026
@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 19, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as resolved.

@nodejs-github-bot

This comment was marked as resolved.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@trivikrtrivikr added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Aug 23, 2026
@nodejs-github-bot
nodejs-github-bot merged commit 0449521 into nodejs:mainAug 23, 2026
89 of 90 checks passed
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Landed in 0449521

@nodejs-github-botnodejs-github-bot removed the commit-queue PRs queued for automated landing through the Commit Queue. label Aug 23, 2026
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
PR-URL: #65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
PR-URL: #65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author readyPRs with CI started, the required approvals, and no outstanding review comments.c++Issues and PRs that require attention from people who are familiar with C++.http_parserIssues and PRs related to the HTTP parser implementation or http_parser binding.needs-ciPRs that need a full CI run.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@mcollina@nodejs-github-bot@ShogunPanda@jasnell@ronag@trivikr
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Skip to content

http: use intrusive lists in ConnectionsList - #65296

Merged
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
mcollina:http-connectionslist-intrusive
Aug 23, 2026
Merged

http: use intrusive lists in ConnectionsList#65296
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
mcollina:http-connectionslist-intrusive

Conversation

@mcollina

@mcollinamcollina commented Aug 15, 2026

Copy link
Copy Markdown
Member

Every HTTP message was performing multiple erase and insert operations on the two std::set instances in ConnectionsList, which are ordered by a key (last_message_start_) that mutates on every message. In a hello-world server profile this showed up as ~2.2% of total CPU cycles spent in red-black tree rebalancing plus tree-node allocations, all on the per-request hot path.

This PR replaces both sets with intrusive doubly-linked lists:

  • A node is linked to itself when it is not in a list, so Remove() is idempotent and the destructor unlinks automatically, which also removes the old "Pop from the lists BEFORE resetting last_message_start_" footgun.
  • Membership in the "all connections" list no longer changes per message, so the Pop+Push pair in on_message_begin/on_message_complete is gone entirely.
  • Updating the active list is now a single O(1) unlink + tail append with no allocations.
  • Appending to the tail keeps the active list ordered by last_message_start_ because uv_hrtime() is monotonic, so expired() semantics are unchanged. The arrays returned by all()/idle()/active() are now in insertion order instead of comparator order; none of their consumers depend on ordering.

Benchmark results (Linux, i7-7700, server and benchmarker pinned to separate cores):

 confidence improvement accuracy (*) (**) (***)
http/simple.js duration=5 chunkedEnc=0 c=50 chunks=1 len=4 type='bytes' benchmarker='wrk' ** 4.06 % ±2.41% ±3.23% ±4.25%
http/simple.js duration=5 chunkedEnc=0 c=500 chunks=1 len=4 type='bytes' benchmarker='wrk' 2.35 % ±2.45% ±3.29% ±4.34%

A separate interleaved wrk A/B (hello-world server, -t2 -c50, 5 alternating pairs) shows +4.9% (26,599 → 27,914 req/s), with the patched binary winning every pair. A perf profile of the patched binary confirms the _Rb_tree symbols are gone and malloc traffic in the parser path is roughly halved.

This PR was prepared with the help of AI assistance.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/http
  • @nodejs/net

@nodejs-github-botnodejs-github-bot added c++ Issues and PRs that require attention from people who are familiar with C++. http_parser Issues and PRs related to the HTTP parser implementation or http_parser binding. needs-ci PRs that need a full CI run. labels Aug 15, 2026
@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from e7c6580 to 41044a2CompareAugust 15, 2026 04:07
@codecov

codecovBot commented Aug 15, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 86.27451% with 7 lines in your changes missing coverage. Please review.
✅ Project coverage is 90.12%. Comparing base (347e266) to head (0cc64e0).
⚠️ Report is 269 commits behind head on main.

Files with missing linesPatch %Lines
src/node_http_parser.cc86.27%7 Missing ⚠️
Additional details and impacted files
@@ Coverage Diff @@## main #65296 +/- ##
==========================================
- Coverage 90.30% 90.12% -0.19% 
==========================================
Files 759 752 -7 Lines 248294 251826 +3532 Branches 46860 47356 +496 ==========================================
+ Hits 224220 226954 +2734 - Misses 15516 16225 +709 - Partials 8558 8647 +89 
Files with missing linesCoverage Δ
src/node_http_parser.cc84.72% <86.27%> (-0.26%)⬇️

... and 174 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@ronagronag left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have you benchmarked against an unordered_set or just a plain vector?

I suspect those would be more cache friendly and avoid pointer chasing.

@ronagronag added author ready PRs with CI started, the required approvals, and no outstanding review comments. request-ci Add this label to start a Jenkins CI on a PR. labels Aug 16, 2026
@ronag
ronag requested a review from jasnellAugust 16, 2026 07:59
@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 16, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as outdated.

@ronagronag added the commit-queue PRs queued for automated landing through the Commit Queue. label Aug 17, 2026
@nodejs-github-botnodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Aug 17, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/65296
✔ Done loading data for nodejs/node/pull/65296
----------------------------------- PR info ------------------------------------
Title http: use intrusive lists in ConnectionsList (#65296)
Author Matteo Collina <matteo.collina@gmail.com> (@mcollina)
Branch mcollina:http-connectionslist-intrusive -> nodejs:main
Labels c++, http_parser, author ready, needs-ci, commit-queue
Commits 1
- http: use intrusive lists in ConnectionsList
Committers 1
- Matteo Collina <hello@matteocollina.com>
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
--------------------------------------------------------------------------------
ℹ This PR was created on Sat, 15 Aug 2026 04:05:15 GMT
✔ Approvals: 2
✔ - Robert Nagy (@ronag) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4943029706
✔ - Paolo Insogna (@ShogunPanda) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4949195971
✘ 3 GitHub CI job(s) failed:
✘ - format-cpp: FAILURE (https://github.com/nodejs/node/actions/runs/31863623606/job/94961040997)
✘ - lint-commit-message: FAILURE (https://github.com/nodejs/node/actions/runs/31863623617/job/94961006361)
✘ - test-macOS: FAILURE (https://github.com/nodejs/node/actions/runs/31863623630/job/94961038864)
ℹ Last Full PR CI on 2026-08-16T15:24:03Z: https://ci.nodejs.org/job/node-test-pull-request/75886/
- Querying data for job/node-test-pull-request/75886/
✔ Build data downloaded
- Querying failures of job/node-test-commit/90616/
✔ Data downloaded
✘ 2 failure(s) on the last Jenkins CI run
--------------------------------------------------------------------------------
✔ Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/32009841931

@nodejs-github-bot

This comment was marked as outdated.

@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from 41044a2 to 340ded7CompareAugust 17, 2026 15:45
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from 340ded7 to 0cc64e0CompareAugust 17, 2026 16:16
@ronagronag added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Aug 19, 2026
@nodejs-github-botnodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Aug 19, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/65296
✔ Done loading data for nodejs/node/pull/65296
----------------------------------- PR info ------------------------------------
Title http: use intrusive lists in ConnectionsList (#65296)
Author Matteo Collina <matteo.collina@gmail.com> (@mcollina)
Branch mcollina:http-connectionslist-intrusive -> nodejs:main
Labels c++, http_parser, author ready, needs-ci, commit-queue
Commits 1
- http: use intrusive lists in ConnectionsList
Committers 1
- Matteo Collina <hello@matteocollina.com>
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
--------------------------------------------------------------------------------
ℹ This PR was created on Sat, 15 Aug 2026 04:05:15 GMT
✔ Approvals: 3
✔ - Robert Nagy (@ronag) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4943029706
✔ - Paolo Insogna (@ShogunPanda) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4969028193
✔ - James M Snell (@jasnell) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4951932271
✔ Last GitHub CI successful
ℹ Last Full PR CI on 2026-08-17T08:31:16Z: https://ci.nodejs.org/job/node-test-pull-request/75919/
⚠ Commits were pushed after the last Full PR CI run:
⚠ - http: use intrusive lists in ConnectionsList
- Querying data for job/node-test-pull-request/75919/
✔ Build data downloaded
✔ Last Jenkins CI successful
--------------------------------------------------------------------------------
✔ Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/32254812825

@mcollinamcollina added the request-ci Add this label to start a Jenkins CI on a PR. label Aug 19, 2026
@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 19, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as resolved.

@nodejs-github-bot

This comment was marked as resolved.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@trivikrtrivikr added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Aug 23, 2026
@nodejs-github-bot
nodejs-github-bot merged commit 0449521 into nodejs:mainAug 23, 2026
89 of 90 checks passed
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Landed in 0449521

@nodejs-github-botnodejs-github-bot removed the commit-queue PRs queued for automated landing through the Commit Queue. label Aug 23, 2026
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
PR-URL: #65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
PR-URL: #65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author readyPRs with CI started, the required approvals, and no outstanding review comments.c++Issues and PRs that require attention from people who are familiar with C++.http_parserIssues and PRs related to the HTTP parser implementation or http_parser binding.needs-ciPRs that need a full CI run.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@mcollina@nodejs-github-bot@ShogunPanda@jasnell@ronag@trivikr
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

http: use intrusive lists in ConnectionsList - #65296

Merged
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
mcollina:http-connectionslist-intrusive
Aug 23, 2026
Merged

http: use intrusive lists in ConnectionsList#65296
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
mcollina:http-connectionslist-intrusive

Conversation

@mcollina

@mcollinamcollina commented Aug 15, 2026

Copy link
Copy Markdown
Member

Every HTTP message was performing multiple erase and insert operations on the two std::set instances in ConnectionsList, which are ordered by a key (last_message_start_) that mutates on every message. In a hello-world server profile this showed up as ~2.2% of total CPU cycles spent in red-black tree rebalancing plus tree-node allocations, all on the per-request hot path.

This PR replaces both sets with intrusive doubly-linked lists:

  • A node is linked to itself when it is not in a list, so Remove() is idempotent and the destructor unlinks automatically, which also removes the old "Pop from the lists BEFORE resetting last_message_start_" footgun.
  • Membership in the "all connections" list no longer changes per message, so the Pop+Push pair in on_message_begin/on_message_complete is gone entirely.
  • Updating the active list is now a single O(1) unlink + tail append with no allocations.
  • Appending to the tail keeps the active list ordered by last_message_start_ because uv_hrtime() is monotonic, so expired() semantics are unchanged. The arrays returned by all()/idle()/active() are now in insertion order instead of comparator order; none of their consumers depend on ordering.

Benchmark results (Linux, i7-7700, server and benchmarker pinned to separate cores):

 confidence improvement accuracy (*) (**) (***)
http/simple.js duration=5 chunkedEnc=0 c=50 chunks=1 len=4 type='bytes' benchmarker='wrk' ** 4.06 % ±2.41% ±3.23% ±4.25%
http/simple.js duration=5 chunkedEnc=0 c=500 chunks=1 len=4 type='bytes' benchmarker='wrk' 2.35 % ±2.45% ±3.29% ±4.34%

A separate interleaved wrk A/B (hello-world server, -t2 -c50, 5 alternating pairs) shows +4.9% (26,599 → 27,914 req/s), with the patched binary winning every pair. A perf profile of the patched binary confirms the _Rb_tree symbols are gone and malloc traffic in the parser path is roughly halved.

This PR was prepared with the help of AI assistance.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/http
  • @nodejs/net

@nodejs-github-botnodejs-github-bot added c++ Issues and PRs that require attention from people who are familiar with C++. http_parser Issues and PRs related to the HTTP parser implementation or http_parser binding. needs-ci PRs that need a full CI run. labels Aug 15, 2026
@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from e7c6580 to 41044a2CompareAugust 15, 2026 04:07
@codecov

codecovBot commented Aug 15, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 86.27451% with 7 lines in your changes missing coverage. Please review.
✅ Project coverage is 90.12%. Comparing base (347e266) to head (0cc64e0).
⚠️ Report is 269 commits behind head on main.

Files with missing linesPatch %Lines
src/node_http_parser.cc86.27%7 Missing ⚠️
Additional details and impacted files
@@ Coverage Diff @@## main #65296 +/- ##
==========================================
- Coverage 90.30% 90.12% -0.19% 
==========================================
Files 759 752 -7 Lines 248294 251826 +3532 Branches 46860 47356 +496 ==========================================
+ Hits 224220 226954 +2734 - Misses 15516 16225 +709 - Partials 8558 8647 +89 
Files with missing linesCoverage Δ
src/node_http_parser.cc84.72% <86.27%> (-0.26%)⬇️

... and 174 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@ronagronag left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have you benchmarked against an unordered_set or just a plain vector?

I suspect those would be more cache friendly and avoid pointer chasing.

@ronagronag added author ready PRs with CI started, the required approvals, and no outstanding review comments. request-ci Add this label to start a Jenkins CI on a PR. labels Aug 16, 2026
@ronag
ronag requested a review from jasnellAugust 16, 2026 07:59
@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 16, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as outdated.

@ronagronag added the commit-queue PRs queued for automated landing through the Commit Queue. label Aug 17, 2026
@nodejs-github-botnodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Aug 17, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/65296
✔ Done loading data for nodejs/node/pull/65296
----------------------------------- PR info ------------------------------------
Title http: use intrusive lists in ConnectionsList (#65296)
Author Matteo Collina <matteo.collina@gmail.com> (@mcollina)
Branch mcollina:http-connectionslist-intrusive -> nodejs:main
Labels c++, http_parser, author ready, needs-ci, commit-queue
Commits 1
- http: use intrusive lists in ConnectionsList
Committers 1
- Matteo Collina <hello@matteocollina.com>
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
--------------------------------------------------------------------------------
ℹ This PR was created on Sat, 15 Aug 2026 04:05:15 GMT
✔ Approvals: 2
✔ - Robert Nagy (@ronag) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4943029706
✔ - Paolo Insogna (@ShogunPanda) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4949195971
✘ 3 GitHub CI job(s) failed:
✘ - format-cpp: FAILURE (https://github.com/nodejs/node/actions/runs/31863623606/job/94961040997)
✘ - lint-commit-message: FAILURE (https://github.com/nodejs/node/actions/runs/31863623617/job/94961006361)
✘ - test-macOS: FAILURE (https://github.com/nodejs/node/actions/runs/31863623630/job/94961038864)
ℹ Last Full PR CI on 2026-08-16T15:24:03Z: https://ci.nodejs.org/job/node-test-pull-request/75886/
- Querying data for job/node-test-pull-request/75886/
✔ Build data downloaded
- Querying failures of job/node-test-commit/90616/
✔ Data downloaded
✘ 2 failure(s) on the last Jenkins CI run
--------------------------------------------------------------------------------
✔ Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/32009841931

@nodejs-github-bot

This comment was marked as outdated.

@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from 41044a2 to 340ded7CompareAugust 17, 2026 15:45
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from 340ded7 to 0cc64e0CompareAugust 17, 2026 16:16
@ronagronag added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Aug 19, 2026
@nodejs-github-botnodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Aug 19, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/65296
✔ Done loading data for nodejs/node/pull/65296
----------------------------------- PR info ------------------------------------
Title http: use intrusive lists in ConnectionsList (#65296)
Author Matteo Collina <matteo.collina@gmail.com> (@mcollina)
Branch mcollina:http-connectionslist-intrusive -> nodejs:main
Labels c++, http_parser, author ready, needs-ci, commit-queue
Commits 1
- http: use intrusive lists in ConnectionsList
Committers 1
- Matteo Collina <hello@matteocollina.com>
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
--------------------------------------------------------------------------------
ℹ This PR was created on Sat, 15 Aug 2026 04:05:15 GMT
✔ Approvals: 3
✔ - Robert Nagy (@ronag) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4943029706
✔ - Paolo Insogna (@ShogunPanda) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4969028193
✔ - James M Snell (@jasnell) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4951932271
✔ Last GitHub CI successful
ℹ Last Full PR CI on 2026-08-17T08:31:16Z: https://ci.nodejs.org/job/node-test-pull-request/75919/
⚠ Commits were pushed after the last Full PR CI run:
⚠ - http: use intrusive lists in ConnectionsList
- Querying data for job/node-test-pull-request/75919/
✔ Build data downloaded
✔ Last Jenkins CI successful
--------------------------------------------------------------------------------
✔ Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/32254812825

@mcollinamcollina added the request-ci Add this label to start a Jenkins CI on a PR. label Aug 19, 2026
@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 19, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as resolved.

@nodejs-github-bot

This comment was marked as resolved.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@trivikrtrivikr added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Aug 23, 2026
@nodejs-github-bot
nodejs-github-bot merged commit 0449521 into nodejs:mainAug 23, 2026
89 of 90 checks passed
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Landed in 0449521

@nodejs-github-botnodejs-github-bot removed the commit-queue PRs queued for automated landing through the Commit Queue. label Aug 23, 2026
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
PR-URL: #65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
PR-URL: #65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author readyPRs with CI started, the required approvals, and no outstanding review comments.c++Issues and PRs that require attention from people who are familiar with C++.http_parserIssues and PRs related to the HTTP parser implementation or http_parser binding.needs-ciPRs that need a full CI run.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@mcollina@nodejs-github-bot@ShogunPanda@jasnell@ronag@trivikr
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

http: use intrusive lists in ConnectionsList - #65296

Merged
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
mcollina:http-connectionslist-intrusive
Aug 23, 2026
Merged

http: use intrusive lists in ConnectionsList#65296
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
mcollina:http-connectionslist-intrusive

Conversation

@mcollina

@mcollinamcollina commented Aug 15, 2026

Copy link
Copy Markdown
Member

Every HTTP message was performing multiple erase and insert operations on the two std::set instances in ConnectionsList, which are ordered by a key (last_message_start_) that mutates on every message. In a hello-world server profile this showed up as ~2.2% of total CPU cycles spent in red-black tree rebalancing plus tree-node allocations, all on the per-request hot path.

This PR replaces both sets with intrusive doubly-linked lists:

  • A node is linked to itself when it is not in a list, so Remove() is idempotent and the destructor unlinks automatically, which also removes the old "Pop from the lists BEFORE resetting last_message_start_" footgun.
  • Membership in the "all connections" list no longer changes per message, so the Pop+Push pair in on_message_begin/on_message_complete is gone entirely.
  • Updating the active list is now a single O(1) unlink + tail append with no allocations.
  • Appending to the tail keeps the active list ordered by last_message_start_ because uv_hrtime() is monotonic, so expired() semantics are unchanged. The arrays returned by all()/idle()/active() are now in insertion order instead of comparator order; none of their consumers depend on ordering.

Benchmark results (Linux, i7-7700, server and benchmarker pinned to separate cores):

 confidence improvement accuracy (*) (**) (***)
http/simple.js duration=5 chunkedEnc=0 c=50 chunks=1 len=4 type='bytes' benchmarker='wrk' ** 4.06 % ±2.41% ±3.23% ±4.25%
http/simple.js duration=5 chunkedEnc=0 c=500 chunks=1 len=4 type='bytes' benchmarker='wrk' 2.35 % ±2.45% ±3.29% ±4.34%

A separate interleaved wrk A/B (hello-world server, -t2 -c50, 5 alternating pairs) shows +4.9% (26,599 → 27,914 req/s), with the patched binary winning every pair. A perf profile of the patched binary confirms the _Rb_tree symbols are gone and malloc traffic in the parser path is roughly halved.

This PR was prepared with the help of AI assistance.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/http
  • @nodejs/net

@nodejs-github-botnodejs-github-bot added c++ Issues and PRs that require attention from people who are familiar with C++. http_parser Issues and PRs related to the HTTP parser implementation or http_parser binding. needs-ci PRs that need a full CI run. labels Aug 15, 2026
@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from e7c6580 to 41044a2CompareAugust 15, 2026 04:07
@codecov

codecovBot commented Aug 15, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 86.27451% with 7 lines in your changes missing coverage. Please review.
✅ Project coverage is 90.12%. Comparing base (347e266) to head (0cc64e0).
⚠️ Report is 269 commits behind head on main.

Files with missing linesPatch %Lines
src/node_http_parser.cc86.27%7 Missing ⚠️
Additional details and impacted files
@@ Coverage Diff @@## main #65296 +/- ##
==========================================
- Coverage 90.30% 90.12% -0.19% 
==========================================
Files 759 752 -7 Lines 248294 251826 +3532 Branches 46860 47356 +496 ==========================================
+ Hits 224220 226954 +2734 - Misses 15516 16225 +709 - Partials 8558 8647 +89 
Files with missing linesCoverage Δ
src/node_http_parser.cc84.72% <86.27%> (-0.26%)⬇️

... and 174 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@ronagronag left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have you benchmarked against an unordered_set or just a plain vector?

I suspect those would be more cache friendly and avoid pointer chasing.

@ronagronag added author ready PRs with CI started, the required approvals, and no outstanding review comments. request-ci Add this label to start a Jenkins CI on a PR. labels Aug 16, 2026
@ronag
ronag requested a review from jasnellAugust 16, 2026 07:59
@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 16, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as outdated.

@ronagronag added the commit-queue PRs queued for automated landing through the Commit Queue. label Aug 17, 2026
@nodejs-github-botnodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Aug 17, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/65296
✔ Done loading data for nodejs/node/pull/65296
----------------------------------- PR info ------------------------------------
Title http: use intrusive lists in ConnectionsList (#65296)
Author Matteo Collina <matteo.collina@gmail.com> (@mcollina)
Branch mcollina:http-connectionslist-intrusive -> nodejs:main
Labels c++, http_parser, author ready, needs-ci, commit-queue
Commits 1
- http: use intrusive lists in ConnectionsList
Committers 1
- Matteo Collina <hello@matteocollina.com>
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
--------------------------------------------------------------------------------
ℹ This PR was created on Sat, 15 Aug 2026 04:05:15 GMT
✔ Approvals: 2
✔ - Robert Nagy (@ronag) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4943029706
✔ - Paolo Insogna (@ShogunPanda) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4949195971
✘ 3 GitHub CI job(s) failed:
✘ - format-cpp: FAILURE (https://github.com/nodejs/node/actions/runs/31863623606/job/94961040997)
✘ - lint-commit-message: FAILURE (https://github.com/nodejs/node/actions/runs/31863623617/job/94961006361)
✘ - test-macOS: FAILURE (https://github.com/nodejs/node/actions/runs/31863623630/job/94961038864)
ℹ Last Full PR CI on 2026-08-16T15:24:03Z: https://ci.nodejs.org/job/node-test-pull-request/75886/
- Querying data for job/node-test-pull-request/75886/
✔ Build data downloaded
- Querying failures of job/node-test-commit/90616/
✔ Data downloaded
✘ 2 failure(s) on the last Jenkins CI run
--------------------------------------------------------------------------------
✔ Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/32009841931

@nodejs-github-bot

This comment was marked as outdated.

@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from 41044a2 to 340ded7CompareAugust 17, 2026 15:45
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from 340ded7 to 0cc64e0CompareAugust 17, 2026 16:16
@ronagronag added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Aug 19, 2026
@nodejs-github-botnodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Aug 19, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/65296
✔ Done loading data for nodejs/node/pull/65296
----------------------------------- PR info ------------------------------------
Title http: use intrusive lists in ConnectionsList (#65296)
Author Matteo Collina <matteo.collina@gmail.com> (@mcollina)
Branch mcollina:http-connectionslist-intrusive -> nodejs:main
Labels c++, http_parser, author ready, needs-ci, commit-queue
Commits 1
- http: use intrusive lists in ConnectionsList
Committers 1
- Matteo Collina <hello@matteocollina.com>
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
--------------------------------------------------------------------------------
ℹ This PR was created on Sat, 15 Aug 2026 04:05:15 GMT
✔ Approvals: 3
✔ - Robert Nagy (@ronag) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4943029706
✔ - Paolo Insogna (@ShogunPanda) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4969028193
✔ - James M Snell (@jasnell) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4951932271
✔ Last GitHub CI successful
ℹ Last Full PR CI on 2026-08-17T08:31:16Z: https://ci.nodejs.org/job/node-test-pull-request/75919/
⚠ Commits were pushed after the last Full PR CI run:
⚠ - http: use intrusive lists in ConnectionsList
- Querying data for job/node-test-pull-request/75919/
✔ Build data downloaded
✔ Last Jenkins CI successful
--------------------------------------------------------------------------------
✔ Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/32254812825

@mcollinamcollina added the request-ci Add this label to start a Jenkins CI on a PR. label Aug 19, 2026
@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 19, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as resolved.

@nodejs-github-bot

This comment was marked as resolved.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@trivikrtrivikr added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Aug 23, 2026
@nodejs-github-bot
nodejs-github-bot merged commit 0449521 into nodejs:mainAug 23, 2026
89 of 90 checks passed
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Landed in 0449521

@nodejs-github-botnodejs-github-bot removed the commit-queue PRs queued for automated landing through the Commit Queue. label Aug 23, 2026
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
PR-URL: #65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
PR-URL: #65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author readyPRs with CI started, the required approvals, and no outstanding review comments.c++Issues and PRs that require attention from people who are familiar with C++.http_parserIssues and PRs related to the HTTP parser implementation or http_parser binding.needs-ciPRs that need a full CI run.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@mcollina@nodejs-github-bot@ShogunPanda@jasnell@ronag@trivikr
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
Skip to content

http: use intrusive lists in ConnectionsList - #65296

Merged
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
mcollina:http-connectionslist-intrusive
Aug 23, 2026
Merged

http: use intrusive lists in ConnectionsList#65296
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
mcollina:http-connectionslist-intrusive

Conversation

@mcollina

@mcollinamcollina commented Aug 15, 2026

Copy link
Copy Markdown
Member

Every HTTP message was performing multiple erase and insert operations on the two std::set instances in ConnectionsList, which are ordered by a key (last_message_start_) that mutates on every message. In a hello-world server profile this showed up as ~2.2% of total CPU cycles spent in red-black tree rebalancing plus tree-node allocations, all on the per-request hot path.

This PR replaces both sets with intrusive doubly-linked lists:

  • A node is linked to itself when it is not in a list, so Remove() is idempotent and the destructor unlinks automatically, which also removes the old "Pop from the lists BEFORE resetting last_message_start_" footgun.
  • Membership in the "all connections" list no longer changes per message, so the Pop+Push pair in on_message_begin/on_message_complete is gone entirely.
  • Updating the active list is now a single O(1) unlink + tail append with no allocations.
  • Appending to the tail keeps the active list ordered by last_message_start_ because uv_hrtime() is monotonic, so expired() semantics are unchanged. The arrays returned by all()/idle()/active() are now in insertion order instead of comparator order; none of their consumers depend on ordering.

Benchmark results (Linux, i7-7700, server and benchmarker pinned to separate cores):

 confidence improvement accuracy (*) (**) (***)
http/simple.js duration=5 chunkedEnc=0 c=50 chunks=1 len=4 type='bytes' benchmarker='wrk' ** 4.06 % ±2.41% ±3.23% ±4.25%
http/simple.js duration=5 chunkedEnc=0 c=500 chunks=1 len=4 type='bytes' benchmarker='wrk' 2.35 % ±2.45% ±3.29% ±4.34%

A separate interleaved wrk A/B (hello-world server, -t2 -c50, 5 alternating pairs) shows +4.9% (26,599 → 27,914 req/s), with the patched binary winning every pair. A perf profile of the patched binary confirms the _Rb_tree symbols are gone and malloc traffic in the parser path is roughly halved.

This PR was prepared with the help of AI assistance.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/http
  • @nodejs/net

@nodejs-github-botnodejs-github-bot added c++ Issues and PRs that require attention from people who are familiar with C++. http_parser Issues and PRs related to the HTTP parser implementation or http_parser binding. needs-ci PRs that need a full CI run. labels Aug 15, 2026
@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from e7c6580 to 41044a2CompareAugust 15, 2026 04:07
@codecov

codecovBot commented Aug 15, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 86.27451% with 7 lines in your changes missing coverage. Please review.
✅ Project coverage is 90.12%. Comparing base (347e266) to head (0cc64e0).
⚠️ Report is 269 commits behind head on main.

Files with missing linesPatch %Lines
src/node_http_parser.cc86.27%7 Missing ⚠️
Additional details and impacted files
@@ Coverage Diff @@## main #65296 +/- ##
==========================================
- Coverage 90.30% 90.12% -0.19% 
==========================================
Files 759 752 -7 Lines 248294 251826 +3532 Branches 46860 47356 +496 ==========================================
+ Hits 224220 226954 +2734 - Misses 15516 16225 +709 - Partials 8558 8647 +89 
Files with missing linesCoverage Δ
src/node_http_parser.cc84.72% <86.27%> (-0.26%)⬇️

... and 174 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@ronagronag left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have you benchmarked against an unordered_set or just a plain vector?

I suspect those would be more cache friendly and avoid pointer chasing.

@ronagronag added author ready PRs with CI started, the required approvals, and no outstanding review comments. request-ci Add this label to start a Jenkins CI on a PR. labels Aug 16, 2026
@ronag
ronag requested a review from jasnellAugust 16, 2026 07:59
@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 16, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as outdated.

@ronagronag added the commit-queue PRs queued for automated landing through the Commit Queue. label Aug 17, 2026
@nodejs-github-botnodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Aug 17, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/65296
✔ Done loading data for nodejs/node/pull/65296
----------------------------------- PR info ------------------------------------
Title http: use intrusive lists in ConnectionsList (#65296)
Author Matteo Collina <matteo.collina@gmail.com> (@mcollina)
Branch mcollina:http-connectionslist-intrusive -> nodejs:main
Labels c++, http_parser, author ready, needs-ci, commit-queue
Commits 1
- http: use intrusive lists in ConnectionsList
Committers 1
- Matteo Collina <hello@matteocollina.com>
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
--------------------------------------------------------------------------------
ℹ This PR was created on Sat, 15 Aug 2026 04:05:15 GMT
✔ Approvals: 2
✔ - Robert Nagy (@ronag) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4943029706
✔ - Paolo Insogna (@ShogunPanda) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4949195971
✘ 3 GitHub CI job(s) failed:
✘ - format-cpp: FAILURE (https://github.com/nodejs/node/actions/runs/31863623606/job/94961040997)
✘ - lint-commit-message: FAILURE (https://github.com/nodejs/node/actions/runs/31863623617/job/94961006361)
✘ - test-macOS: FAILURE (https://github.com/nodejs/node/actions/runs/31863623630/job/94961038864)
ℹ Last Full PR CI on 2026-08-16T15:24:03Z: https://ci.nodejs.org/job/node-test-pull-request/75886/
- Querying data for job/node-test-pull-request/75886/
✔ Build data downloaded
- Querying failures of job/node-test-commit/90616/
✔ Data downloaded
✘ 2 failure(s) on the last Jenkins CI run
--------------------------------------------------------------------------------
✔ Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/32009841931

@nodejs-github-bot

This comment was marked as outdated.

@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from 41044a2 to 340ded7CompareAugust 17, 2026 15:45
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from 340ded7 to 0cc64e0CompareAugust 17, 2026 16:16
@ronagronag added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Aug 19, 2026
@nodejs-github-botnodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Aug 19, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/65296
✔ Done loading data for nodejs/node/pull/65296
----------------------------------- PR info ------------------------------------
Title http: use intrusive lists in ConnectionsList (#65296)
Author Matteo Collina <matteo.collina@gmail.com> (@mcollina)
Branch mcollina:http-connectionslist-intrusive -> nodejs:main
Labels c++, http_parser, author ready, needs-ci, commit-queue
Commits 1
- http: use intrusive lists in ConnectionsList
Committers 1
- Matteo Collina <hello@matteocollina.com>
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
--------------------------------------------------------------------------------
ℹ This PR was created on Sat, 15 Aug 2026 04:05:15 GMT
✔ Approvals: 3
✔ - Robert Nagy (@ronag) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4943029706
✔ - Paolo Insogna (@ShogunPanda) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4969028193
✔ - James M Snell (@jasnell) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4951932271
✔ Last GitHub CI successful
ℹ Last Full PR CI on 2026-08-17T08:31:16Z: https://ci.nodejs.org/job/node-test-pull-request/75919/
⚠ Commits were pushed after the last Full PR CI run:
⚠ - http: use intrusive lists in ConnectionsList
- Querying data for job/node-test-pull-request/75919/
✔ Build data downloaded
✔ Last Jenkins CI successful
--------------------------------------------------------------------------------
✔ Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/32254812825

@mcollinamcollina added the request-ci Add this label to start a Jenkins CI on a PR. label Aug 19, 2026
@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 19, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as resolved.

@nodejs-github-bot

This comment was marked as resolved.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@trivikrtrivikr added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Aug 23, 2026
@nodejs-github-bot
nodejs-github-bot merged commit 0449521 into nodejs:mainAug 23, 2026
89 of 90 checks passed
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Landed in 0449521

@nodejs-github-botnodejs-github-bot removed the commit-queue PRs queued for automated landing through the Commit Queue. label Aug 23, 2026
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
PR-URL: #65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
PR-URL: #65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author readyPRs with CI started, the required approvals, and no outstanding review comments.c++Issues and PRs that require attention from people who are familiar with C++.http_parserIssues and PRs related to the HTTP parser implementation or http_parser binding.needs-ciPRs that need a full CI run.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@mcollina@nodejs-github-bot@ShogunPanda@jasnell@ronag@trivikr
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

http: use intrusive lists in ConnectionsList - #65296

Merged
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
mcollina:http-connectionslist-intrusive
Aug 23, 2026
Merged

http: use intrusive lists in ConnectionsList#65296
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
mcollina:http-connectionslist-intrusive

Conversation

@mcollina

@mcollinamcollina commented Aug 15, 2026

Copy link
Copy Markdown
Member

Every HTTP message was performing multiple erase and insert operations on the two std::set instances in ConnectionsList, which are ordered by a key (last_message_start_) that mutates on every message. In a hello-world server profile this showed up as ~2.2% of total CPU cycles spent in red-black tree rebalancing plus tree-node allocations, all on the per-request hot path.

This PR replaces both sets with intrusive doubly-linked lists:

  • A node is linked to itself when it is not in a list, so Remove() is idempotent and the destructor unlinks automatically, which also removes the old "Pop from the lists BEFORE resetting last_message_start_" footgun.
  • Membership in the "all connections" list no longer changes per message, so the Pop+Push pair in on_message_begin/on_message_complete is gone entirely.
  • Updating the active list is now a single O(1) unlink + tail append with no allocations.
  • Appending to the tail keeps the active list ordered by last_message_start_ because uv_hrtime() is monotonic, so expired() semantics are unchanged. The arrays returned by all()/idle()/active() are now in insertion order instead of comparator order; none of their consumers depend on ordering.

Benchmark results (Linux, i7-7700, server and benchmarker pinned to separate cores):

 confidence improvement accuracy (*) (**) (***)
http/simple.js duration=5 chunkedEnc=0 c=50 chunks=1 len=4 type='bytes' benchmarker='wrk' ** 4.06 % ±2.41% ±3.23% ±4.25%
http/simple.js duration=5 chunkedEnc=0 c=500 chunks=1 len=4 type='bytes' benchmarker='wrk' 2.35 % ±2.45% ±3.29% ±4.34%

A separate interleaved wrk A/B (hello-world server, -t2 -c50, 5 alternating pairs) shows +4.9% (26,599 → 27,914 req/s), with the patched binary winning every pair. A perf profile of the patched binary confirms the _Rb_tree symbols are gone and malloc traffic in the parser path is roughly halved.

This PR was prepared with the help of AI assistance.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/http
  • @nodejs/net

@nodejs-github-botnodejs-github-bot added c++ Issues and PRs that require attention from people who are familiar with C++. http_parser Issues and PRs related to the HTTP parser implementation or http_parser binding. needs-ci PRs that need a full CI run. labels Aug 15, 2026
@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from e7c6580 to 41044a2CompareAugust 15, 2026 04:07
@codecov

codecovBot commented Aug 15, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 86.27451% with 7 lines in your changes missing coverage. Please review.
✅ Project coverage is 90.12%. Comparing base (347e266) to head (0cc64e0).
⚠️ Report is 269 commits behind head on main.

Files with missing linesPatch %Lines
src/node_http_parser.cc86.27%7 Missing ⚠️
Additional details and impacted files
@@ Coverage Diff @@## main #65296 +/- ##
==========================================
- Coverage 90.30% 90.12% -0.19% 
==========================================
Files 759 752 -7 Lines 248294 251826 +3532 Branches 46860 47356 +496 ==========================================
+ Hits 224220 226954 +2734 - Misses 15516 16225 +709 - Partials 8558 8647 +89 
Files with missing linesCoverage Δ
src/node_http_parser.cc84.72% <86.27%> (-0.26%)⬇️

... and 174 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@ronagronag left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have you benchmarked against an unordered_set or just a plain vector?

I suspect those would be more cache friendly and avoid pointer chasing.

@ronagronag added author ready PRs with CI started, the required approvals, and no outstanding review comments. request-ci Add this label to start a Jenkins CI on a PR. labels Aug 16, 2026
@ronag
ronag requested a review from jasnellAugust 16, 2026 07:59
@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 16, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as outdated.

@ronagronag added the commit-queue PRs queued for automated landing through the Commit Queue. label Aug 17, 2026
@nodejs-github-botnodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Aug 17, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/65296
✔ Done loading data for nodejs/node/pull/65296
----------------------------------- PR info ------------------------------------
Title http: use intrusive lists in ConnectionsList (#65296)
Author Matteo Collina <matteo.collina@gmail.com> (@mcollina)
Branch mcollina:http-connectionslist-intrusive -> nodejs:main
Labels c++, http_parser, author ready, needs-ci, commit-queue
Commits 1
- http: use intrusive lists in ConnectionsList
Committers 1
- Matteo Collina <hello@matteocollina.com>
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
--------------------------------------------------------------------------------
ℹ This PR was created on Sat, 15 Aug 2026 04:05:15 GMT
✔ Approvals: 2
✔ - Robert Nagy (@ronag) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4943029706
✔ - Paolo Insogna (@ShogunPanda) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4949195971
✘ 3 GitHub CI job(s) failed:
✘ - format-cpp: FAILURE (https://github.com/nodejs/node/actions/runs/31863623606/job/94961040997)
✘ - lint-commit-message: FAILURE (https://github.com/nodejs/node/actions/runs/31863623617/job/94961006361)
✘ - test-macOS: FAILURE (https://github.com/nodejs/node/actions/runs/31863623630/job/94961038864)
ℹ Last Full PR CI on 2026-08-16T15:24:03Z: https://ci.nodejs.org/job/node-test-pull-request/75886/
- Querying data for job/node-test-pull-request/75886/
✔ Build data downloaded
- Querying failures of job/node-test-commit/90616/
✔ Data downloaded
✘ 2 failure(s) on the last Jenkins CI run
--------------------------------------------------------------------------------
✔ Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/32009841931

@nodejs-github-bot

This comment was marked as outdated.

@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from 41044a2 to 340ded7CompareAugust 17, 2026 15:45
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from 340ded7 to 0cc64e0CompareAugust 17, 2026 16:16
@ronagronag added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Aug 19, 2026
@nodejs-github-botnodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Aug 19, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/65296
✔ Done loading data for nodejs/node/pull/65296
----------------------------------- PR info ------------------------------------
Title http: use intrusive lists in ConnectionsList (#65296)
Author Matteo Collina <matteo.collina@gmail.com> (@mcollina)
Branch mcollina:http-connectionslist-intrusive -> nodejs:main
Labels c++, http_parser, author ready, needs-ci, commit-queue
Commits 1
- http: use intrusive lists in ConnectionsList
Committers 1
- Matteo Collina <hello@matteocollina.com>
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
--------------------------------------------------------------------------------
ℹ This PR was created on Sat, 15 Aug 2026 04:05:15 GMT
✔ Approvals: 3
✔ - Robert Nagy (@ronag) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4943029706
✔ - Paolo Insogna (@ShogunPanda) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4969028193
✔ - James M Snell (@jasnell) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4951932271
✔ Last GitHub CI successful
ℹ Last Full PR CI on 2026-08-17T08:31:16Z: https://ci.nodejs.org/job/node-test-pull-request/75919/
⚠ Commits were pushed after the last Full PR CI run:
⚠ - http: use intrusive lists in ConnectionsList
- Querying data for job/node-test-pull-request/75919/
✔ Build data downloaded
✔ Last Jenkins CI successful
--------------------------------------------------------------------------------
✔ Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/32254812825

@mcollinamcollina added the request-ci Add this label to start a Jenkins CI on a PR. label Aug 19, 2026
@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 19, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as resolved.

@nodejs-github-bot

This comment was marked as resolved.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@trivikrtrivikr added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Aug 23, 2026
@nodejs-github-bot
nodejs-github-bot merged commit 0449521 into nodejs:mainAug 23, 2026
89 of 90 checks passed
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Landed in 0449521

@nodejs-github-botnodejs-github-bot removed the commit-queue PRs queued for automated landing through the Commit Queue. label Aug 23, 2026
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
PR-URL: #65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
PR-URL: #65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author readyPRs with CI started, the required approvals, and no outstanding review comments.c++Issues and PRs that require attention from people who are familiar with C++.http_parserIssues and PRs related to the HTTP parser implementation or http_parser binding.needs-ciPRs that need a full CI run.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@mcollina@nodejs-github-bot@ShogunPanda@jasnell@ronag@trivikr
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

http: use intrusive lists in ConnectionsList - #65296

Merged
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
mcollina:http-connectionslist-intrusive
Aug 23, 2026
Merged

http: use intrusive lists in ConnectionsList#65296
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
mcollina:http-connectionslist-intrusive

Conversation

@mcollina

@mcollinamcollina commented Aug 15, 2026

Copy link
Copy Markdown
Member

Every HTTP message was performing multiple erase and insert operations on the two std::set instances in ConnectionsList, which are ordered by a key (last_message_start_) that mutates on every message. In a hello-world server profile this showed up as ~2.2% of total CPU cycles spent in red-black tree rebalancing plus tree-node allocations, all on the per-request hot path.

This PR replaces both sets with intrusive doubly-linked lists:

  • A node is linked to itself when it is not in a list, so Remove() is idempotent and the destructor unlinks automatically, which also removes the old "Pop from the lists BEFORE resetting last_message_start_" footgun.
  • Membership in the "all connections" list no longer changes per message, so the Pop+Push pair in on_message_begin/on_message_complete is gone entirely.
  • Updating the active list is now a single O(1) unlink + tail append with no allocations.
  • Appending to the tail keeps the active list ordered by last_message_start_ because uv_hrtime() is monotonic, so expired() semantics are unchanged. The arrays returned by all()/idle()/active() are now in insertion order instead of comparator order; none of their consumers depend on ordering.

Benchmark results (Linux, i7-7700, server and benchmarker pinned to separate cores):

 confidence improvement accuracy (*) (**) (***)
http/simple.js duration=5 chunkedEnc=0 c=50 chunks=1 len=4 type='bytes' benchmarker='wrk' ** 4.06 % ±2.41% ±3.23% ±4.25%
http/simple.js duration=5 chunkedEnc=0 c=500 chunks=1 len=4 type='bytes' benchmarker='wrk' 2.35 % ±2.45% ±3.29% ±4.34%

A separate interleaved wrk A/B (hello-world server, -t2 -c50, 5 alternating pairs) shows +4.9% (26,599 → 27,914 req/s), with the patched binary winning every pair. A perf profile of the patched binary confirms the _Rb_tree symbols are gone and malloc traffic in the parser path is roughly halved.

This PR was prepared with the help of AI assistance.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/http
  • @nodejs/net

@nodejs-github-botnodejs-github-bot added c++ Issues and PRs that require attention from people who are familiar with C++. http_parser Issues and PRs related to the HTTP parser implementation or http_parser binding. needs-ci PRs that need a full CI run. labels Aug 15, 2026
@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from e7c6580 to 41044a2CompareAugust 15, 2026 04:07
@codecov

codecovBot commented Aug 15, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 86.27451% with 7 lines in your changes missing coverage. Please review.
✅ Project coverage is 90.12%. Comparing base (347e266) to head (0cc64e0).
⚠️ Report is 269 commits behind head on main.

Files with missing linesPatch %Lines
src/node_http_parser.cc86.27%7 Missing ⚠️
Additional details and impacted files
@@ Coverage Diff @@## main #65296 +/- ##
==========================================
- Coverage 90.30% 90.12% -0.19% 
==========================================
Files 759 752 -7 Lines 248294 251826 +3532 Branches 46860 47356 +496 ==========================================
+ Hits 224220 226954 +2734 - Misses 15516 16225 +709 - Partials 8558 8647 +89 
Files with missing linesCoverage Δ
src/node_http_parser.cc84.72% <86.27%> (-0.26%)⬇️

... and 174 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@ronagronag left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have you benchmarked against an unordered_set or just a plain vector?

I suspect those would be more cache friendly and avoid pointer chasing.

@ronagronag added author ready PRs with CI started, the required approvals, and no outstanding review comments. request-ci Add this label to start a Jenkins CI on a PR. labels Aug 16, 2026
@ronag
ronag requested a review from jasnellAugust 16, 2026 07:59
@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 16, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as outdated.

@ronagronag added the commit-queue PRs queued for automated landing through the Commit Queue. label Aug 17, 2026
@nodejs-github-botnodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Aug 17, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/65296
✔ Done loading data for nodejs/node/pull/65296
----------------------------------- PR info ------------------------------------
Title http: use intrusive lists in ConnectionsList (#65296)
Author Matteo Collina <matteo.collina@gmail.com> (@mcollina)
Branch mcollina:http-connectionslist-intrusive -> nodejs:main
Labels c++, http_parser, author ready, needs-ci, commit-queue
Commits 1
- http: use intrusive lists in ConnectionsList
Committers 1
- Matteo Collina <hello@matteocollina.com>
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
--------------------------------------------------------------------------------
ℹ This PR was created on Sat, 15 Aug 2026 04:05:15 GMT
✔ Approvals: 2
✔ - Robert Nagy (@ronag) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4943029706
✔ - Paolo Insogna (@ShogunPanda) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4949195971
✘ 3 GitHub CI job(s) failed:
✘ - format-cpp: FAILURE (https://github.com/nodejs/node/actions/runs/31863623606/job/94961040997)
✘ - lint-commit-message: FAILURE (https://github.com/nodejs/node/actions/runs/31863623617/job/94961006361)
✘ - test-macOS: FAILURE (https://github.com/nodejs/node/actions/runs/31863623630/job/94961038864)
ℹ Last Full PR CI on 2026-08-16T15:24:03Z: https://ci.nodejs.org/job/node-test-pull-request/75886/
- Querying data for job/node-test-pull-request/75886/
✔ Build data downloaded
- Querying failures of job/node-test-commit/90616/
✔ Data downloaded
✘ 2 failure(s) on the last Jenkins CI run
--------------------------------------------------------------------------------
✔ Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/32009841931

@nodejs-github-bot

This comment was marked as outdated.

@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from 41044a2 to 340ded7CompareAugust 17, 2026 15:45
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from 340ded7 to 0cc64e0CompareAugust 17, 2026 16:16
@ronagronag added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Aug 19, 2026
@nodejs-github-botnodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Aug 19, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/65296
✔ Done loading data for nodejs/node/pull/65296
----------------------------------- PR info ------------------------------------
Title http: use intrusive lists in ConnectionsList (#65296)
Author Matteo Collina <matteo.collina@gmail.com> (@mcollina)
Branch mcollina:http-connectionslist-intrusive -> nodejs:main
Labels c++, http_parser, author ready, needs-ci, commit-queue
Commits 1
- http: use intrusive lists in ConnectionsList
Committers 1
- Matteo Collina <hello@matteocollina.com>
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
--------------------------------------------------------------------------------
ℹ This PR was created on Sat, 15 Aug 2026 04:05:15 GMT
✔ Approvals: 3
✔ - Robert Nagy (@ronag) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4943029706
✔ - Paolo Insogna (@ShogunPanda) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4969028193
✔ - James M Snell (@jasnell) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4951932271
✔ Last GitHub CI successful
ℹ Last Full PR CI on 2026-08-17T08:31:16Z: https://ci.nodejs.org/job/node-test-pull-request/75919/
⚠ Commits were pushed after the last Full PR CI run:
⚠ - http: use intrusive lists in ConnectionsList
- Querying data for job/node-test-pull-request/75919/
✔ Build data downloaded
✔ Last Jenkins CI successful
--------------------------------------------------------------------------------
✔ Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/32254812825

@mcollinamcollina added the request-ci Add this label to start a Jenkins CI on a PR. label Aug 19, 2026
@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 19, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as resolved.

@nodejs-github-bot

This comment was marked as resolved.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@trivikrtrivikr added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Aug 23, 2026
@nodejs-github-bot
nodejs-github-bot merged commit 0449521 into nodejs:mainAug 23, 2026
89 of 90 checks passed
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Landed in 0449521

@nodejs-github-botnodejs-github-bot removed the commit-queue PRs queued for automated landing through the Commit Queue. label Aug 23, 2026
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
PR-URL: #65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
PR-URL: #65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author readyPRs with CI started, the required approvals, and no outstanding review comments.c++Issues and PRs that require attention from people who are familiar with C++.http_parserIssues and PRs related to the HTTP parser implementation or http_parser binding.needs-ciPRs that need a full CI run.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@mcollina@nodejs-github-bot@ShogunPanda@jasnell@ronag@trivikr
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
Skip to content

http: use intrusive lists in ConnectionsList - #65296

Merged
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
mcollina:http-connectionslist-intrusive
Aug 23, 2026
Merged

http: use intrusive lists in ConnectionsList#65296
nodejs-github-bot merged 1 commit into
nodejs:mainfrom
mcollina:http-connectionslist-intrusive

Conversation

@mcollina

@mcollinamcollina commented Aug 15, 2026

Copy link
Copy Markdown
Member

Every HTTP message was performing multiple erase and insert operations on the two std::set instances in ConnectionsList, which are ordered by a key (last_message_start_) that mutates on every message. In a hello-world server profile this showed up as ~2.2% of total CPU cycles spent in red-black tree rebalancing plus tree-node allocations, all on the per-request hot path.

This PR replaces both sets with intrusive doubly-linked lists:

  • A node is linked to itself when it is not in a list, so Remove() is idempotent and the destructor unlinks automatically, which also removes the old "Pop from the lists BEFORE resetting last_message_start_" footgun.
  • Membership in the "all connections" list no longer changes per message, so the Pop+Push pair in on_message_begin/on_message_complete is gone entirely.
  • Updating the active list is now a single O(1) unlink + tail append with no allocations.
  • Appending to the tail keeps the active list ordered by last_message_start_ because uv_hrtime() is monotonic, so expired() semantics are unchanged. The arrays returned by all()/idle()/active() are now in insertion order instead of comparator order; none of their consumers depend on ordering.

Benchmark results (Linux, i7-7700, server and benchmarker pinned to separate cores):

 confidence improvement accuracy (*) (**) (***)
http/simple.js duration=5 chunkedEnc=0 c=50 chunks=1 len=4 type='bytes' benchmarker='wrk' ** 4.06 % ±2.41% ±3.23% ±4.25%
http/simple.js duration=5 chunkedEnc=0 c=500 chunks=1 len=4 type='bytes' benchmarker='wrk' 2.35 % ±2.45% ±3.29% ±4.34%

A separate interleaved wrk A/B (hello-world server, -t2 -c50, 5 alternating pairs) shows +4.9% (26,599 → 27,914 req/s), with the patched binary winning every pair. A perf profile of the patched binary confirms the _Rb_tree symbols are gone and malloc traffic in the parser path is roughly halved.

This PR was prepared with the help of AI assistance.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Review requested:

  • @nodejs/http
  • @nodejs/net

@nodejs-github-botnodejs-github-bot added c++ Issues and PRs that require attention from people who are familiar with C++. http_parser Issues and PRs related to the HTTP parser implementation or http_parser binding. needs-ci PRs that need a full CI run. labels Aug 15, 2026
@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from e7c6580 to 41044a2CompareAugust 15, 2026 04:07
@codecov

codecovBot commented Aug 15, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 86.27451% with 7 lines in your changes missing coverage. Please review.
✅ Project coverage is 90.12%. Comparing base (347e266) to head (0cc64e0).
⚠️ Report is 269 commits behind head on main.

Files with missing linesPatch %Lines
src/node_http_parser.cc86.27%7 Missing ⚠️
Additional details and impacted files
@@ Coverage Diff @@## main #65296 +/- ##
==========================================
- Coverage 90.30% 90.12% -0.19% 
==========================================
Files 759 752 -7 Lines 248294 251826 +3532 Branches 46860 47356 +496 ==========================================
+ Hits 224220 226954 +2734 - Misses 15516 16225 +709 - Partials 8558 8647 +89 
Files with missing linesCoverage Δ
src/node_http_parser.cc84.72% <86.27%> (-0.26%)⬇️

... and 174 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@ronagronag left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have you benchmarked against an unordered_set or just a plain vector?

I suspect those would be more cache friendly and avoid pointer chasing.

@ronagronag added author ready PRs with CI started, the required approvals, and no outstanding review comments. request-ci Add this label to start a Jenkins CI on a PR. labels Aug 16, 2026
@ronag
ronag requested a review from jasnellAugust 16, 2026 07:59
@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 16, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as outdated.

@ronagronag added the commit-queue PRs queued for automated landing through the Commit Queue. label Aug 17, 2026
@nodejs-github-botnodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Aug 17, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/65296
✔ Done loading data for nodejs/node/pull/65296
----------------------------------- PR info ------------------------------------
Title http: use intrusive lists in ConnectionsList (#65296)
Author Matteo Collina <matteo.collina@gmail.com> (@mcollina)
Branch mcollina:http-connectionslist-intrusive -> nodejs:main
Labels c++, http_parser, author ready, needs-ci, commit-queue
Commits 1
- http: use intrusive lists in ConnectionsList
Committers 1
- Matteo Collina <hello@matteocollina.com>
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
--------------------------------------------------------------------------------
ℹ This PR was created on Sat, 15 Aug 2026 04:05:15 GMT
✔ Approvals: 2
✔ - Robert Nagy (@ronag) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4943029706
✔ - Paolo Insogna (@ShogunPanda) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4949195971
✘ 3 GitHub CI job(s) failed:
✘ - format-cpp: FAILURE (https://github.com/nodejs/node/actions/runs/31863623606/job/94961040997)
✘ - lint-commit-message: FAILURE (https://github.com/nodejs/node/actions/runs/31863623617/job/94961006361)
✘ - test-macOS: FAILURE (https://github.com/nodejs/node/actions/runs/31863623630/job/94961038864)
ℹ Last Full PR CI on 2026-08-16T15:24:03Z: https://ci.nodejs.org/job/node-test-pull-request/75886/
- Querying data for job/node-test-pull-request/75886/
✔ Build data downloaded
- Querying failures of job/node-test-commit/90616/
✔ Data downloaded
✘ 2 failure(s) on the last Jenkins CI run
--------------------------------------------------------------------------------
✔ Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/32009841931

@nodejs-github-bot

This comment was marked as outdated.

@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from 41044a2 to 340ded7CompareAugust 17, 2026 15:45
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
@mcollina
mcollinaforce-pushed the http-connectionslist-intrusive branch from 340ded7 to 0cc64e0CompareAugust 17, 2026 16:16
@ronagronag added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Aug 19, 2026
@nodejs-github-botnodejs-github-bot added commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. and removed commit-queue PRs queued for automated landing through the Commit Queue. labels Aug 19, 2026
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator
Commit Queue failed
- Loading data for nodejs/node/pull/65296
✔ Done loading data for nodejs/node/pull/65296
----------------------------------- PR info ------------------------------------
Title http: use intrusive lists in ConnectionsList (#65296)
Author Matteo Collina <matteo.collina@gmail.com> (@mcollina)
Branch mcollina:http-connectionslist-intrusive -> nodejs:main
Labels c++, http_parser, author ready, needs-ci, commit-queue
Commits 1
- http: use intrusive lists in ConnectionsList
Committers 1
- Matteo Collina <hello@matteocollina.com>
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
------------------------------ Generated metadata ------------------------------
PR-URL: https://github.com/nodejs/node/pull/65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
--------------------------------------------------------------------------------
ℹ This PR was created on Sat, 15 Aug 2026 04:05:15 GMT
✔ Approvals: 3
✔ - Robert Nagy (@ronag) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4943029706
✔ - Paolo Insogna (@ShogunPanda) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4969028193
✔ - James M Snell (@jasnell) (TSC): https://github.com/nodejs/node/pull/65296#pullrequestreview-4951932271
✔ Last GitHub CI successful
ℹ Last Full PR CI on 2026-08-17T08:31:16Z: https://ci.nodejs.org/job/node-test-pull-request/75919/
⚠ Commits were pushed after the last Full PR CI run:
⚠ - http: use intrusive lists in ConnectionsList
- Querying data for job/node-test-pull-request/75919/
✔ Build data downloaded
✔ Last Jenkins CI successful
--------------------------------------------------------------------------------
✔ Aborted `git node land` session in /home/runner/work/node/node/.ncu
https://github.com/nodejs/node/actions/runs/32254812825

@mcollinamcollina added the request-ci Add this label to start a Jenkins CI on a PR. label Aug 19, 2026
@github-actionsgithub-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Aug 19, 2026
@nodejs-github-bot

This comment was marked as outdated.

@nodejs-github-bot

This comment was marked as resolved.

@nodejs-github-bot

This comment was marked as resolved.

@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

@trivikrtrivikr added commit-queue PRs queued for automated landing through the Commit Queue. and removed commit-queue-failed PRs whose Commit Queue landing failed and need manual intervention before retrying. labels Aug 23, 2026
@nodejs-github-bot
nodejs-github-bot merged commit 0449521 into nodejs:mainAug 23, 2026
89 of 90 checks passed
@nodejs-github-bot

Copy link
Copy Markdown
Collaborator

Landed in 0449521

@nodejs-github-botnodejs-github-bot removed the commit-queue PRs queued for automated landing through the Commit Queue. label Aug 23, 2026
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
PR-URL: #65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
aduh95 pushed a commit that referenced this pull request Aug 25, 2026
Every HTTP message was performing multiple erase and insert operations
on two std::set instances ordered by a mutating key, showing up as ~2%
of CPU cycles in a hello-world server profile due to red-black tree
rebalancing and node allocations.
Replace both sets with intrusive doubly-linked lists. Membership in the
list of all connections no longer changes per message, and updating the
active connections list is now O(1) with no allocations. Appending to
the tail keeps the active list ordered by last_message_start_ because
uv_hrtime() is monotonic.
Signed-off-by: Matteo Collina <hello@matteocollina.com>
PR-URL: #65296
Reviewed-By: Robert Nagy <ronagy@icloud.com>
Reviewed-By: Paolo Insogna <paolo@cowtech.it>
Reviewed-By: James M Snell <jasnell@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author readyPRs with CI started, the required approvals, and no outstanding review comments.c++Issues and PRs that require attention from people who are familiar with C++.http_parserIssues and PRs related to the HTTP parser implementation or http_parser binding.needs-ciPRs that need a full CI run.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

@mcollina@nodejs-github-bot@ShogunPanda@jasnell@ronag@trivikr