errors: improve hideStackFrames by Uzlopak · Pull Request #49990 · nodejs/node

Uzlopak · 2023-10-01T09:36:26Z

This PR improves the hideStackFrames logic.

hideStackFrames is used to hide function calls from stracktraces of Errors. E.g. we call Buffer.alloc(size), then we check if the parameter size is an integer and call validateNumber(size, 'size', 0, kMaxLength);.

'use strict'try{Buffer.alloc('1')}catch(err){console.error(err.stack)}

then we get the following stacktrace:

TypeError [ERR_INVALID_ARG_TYPE]: The "size" argument must be of type number. Received type string ('1')
at Function.alloc (node:buffer:393:3)
at Object.<anonymous> (/home/aras/workspace/node/test.js:4:12)
at Module._compile (node:internal/modules/cjs/loader:1369:14)
at Module._extensions..js (node:internal/modules/cjs/loader:1427:10)
at Module.load (node:internal/modules/cjs/loader:1201:32)
at Module._load (node:internal/modules/cjs/loader:1017:12)
at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:104:12)
at node:internal/main/run_main_module:23:47

If we remove the hideStackFrame wrapping for demonstration purposes we get:

TypeError[ERR_INVALID_ARG_TYPE]: The"size"argumentmustbeoftypenumber.Receivedtypestring('1')atvalidateNumber(node:internal/validators:177:11)atFunction.alloc(node:buffer:393:3)atObject.<anonymous>(/home/aras/workspace/node/test.js:4:12)atModule._compile(node:internal/modules/cjs/loader:1369:14)atModule._extensions..js(node:internal/modules/cjs/loader:1427:10)atModule.load(node:internal/modules/cjs/loader:1201:32)atModule._load(node:internal/modules/cjs/loader:1017:12)atFunction.executeUserEntryPoint[asrunMain](node:internal/modules/run_main:104:12)at node:internal/main/run_main_module:23:47

So we have the additional at validateNumber (node:internal/validators:177:11) entry.

We want to hide this frame, as it is some node internal information, and does not give any benefit for the developer.

Javascript has no inline specifier, so we have to hide it differently. In main branch this is solved by prefixing the function name with __node_internal_ and then generating the whole stacktrace with captureLargerStackTrace, which sets Error.stackTraceLimit = Infinity. When we then call Error.stack, prepareStackTrace will filter out the all frames, which start with __node_internal_.

But we dont need the whole stackTrace. We only need a limited number, by default 10 frames.

To achieve this we just generate the necessary stackTrace.

So hideStackFrames will wrap the original function and will capture the correct stack trace if an error is thrown. Functions which are wrapped have to call the HideStackFramesError Errors and wont have a Stack trace.

An edge case is when a function, which uses hideStackFrames calls another function which is wrapped with hideStackFrames. To avoid double generation of the stack, a function which is wrapped with hideStackFrames exposes a function as attribute of the wrapped function called .withoutStackTrace. The outer function will then get the necessary stack trace.

Usually double wrapped functions are validators. I would have liked to extract them all into validators.js or into module/validators.js. But this would have reduced the readability further.

nodejs-github-bot · 2023-10-01T09:36:30Z

Review requested:

@nodejs/http
@nodejs/http2
@nodejs/net

mcollina · 2023-10-01T09:52:06Z

what's the benefit/performance diff?

Uzlopak · 2023-10-01T10:44:20Z

My benchmarks dont show regressions.
But if we go on, I would ensure that all touched code does not contain any perf regressions.

The benefit is, that the stack trace will be generated propery, without the need to call captureLargerStackTrace. So we wont be forced to keep infinity amount of CallSites just to kick some.

On the long run, i want to try to remove prepareStackTrace.

Currently i investigate what this overrideStackTrace Map is doing, and how we can avoid it.

benjamingr · 2023-10-01T11:54:46Z

Won't this mess with the .name of the error and how stack traces look (vs the previous implementation)?

The only reason i created this class, was because to avoid to patch everywhere the logic for Error.stackTraceLimit over and over.
The name should be the same imho. But i can tackle it.

Thanks let me know when ready

Does this test cover the issue?
https://github.com/nodejs/node/blob/37685b5b2c759035fb0fa551cea2303f9b9661bf/test/parallel/test-errors-hide-stack-frames.js#L32

Uzlopak · 2023-10-02T07:58:40Z

The existing tests pass.

Next step is to remove the captureLargerStackTrace function and ensure that the logic is equivalent.

Imho this is an exciting PR for me. If done right, this should improve the performance of basically every error case. And tbh it seems to be a smart solution (patting on my own shoulder).

Also it will cover all the validateX functions.so it should expose less unnecessary stacks.

Uzlopak · 2023-10-02T18:17:56Z

note to myself: Investigate https://docs.google.com/document/d/13Sy_kBIJGP0XT34V1CV3nkWya4TwYx9L3Yv45LdGB6Q/edit#heading=h.9ss45aibqpw2

Uzlopak · 2023-10-04T20:12:17Z

@anonrig can you please add the author-ready tag?

I would like to discuss this.

anonrig · 2023-10-04T20:24:25Z

@anonrig can you please add the author-ready tag?

author-ready requires at least 1 collaborator approval. I don't have enough knowledge to review this. I recommend @benjamingr or @mcollina to leave a review before adding author-ready

nodejs-github-bot · 2023-10-04T20:30:31Z

CI: https://ci.nodejs.org/job/node-test-pull-request/54542/

targos · 2023-10-05T06:44:39Z

Also @BridgeAR

mcollina

lgtm

mcollina · 2023-10-13T05:47:13Z

You are correct

Uzlopak · 2023-10-13T09:59:01Z

- });
+ if (otherClasses.includes(HideStackFramesError)) {
+ if (otherClasses.length !== 1) {
+ otherClasses.forEach((clazz) => {


@mcollina
@anonrig
Should we use a for loop instead?

Uzlopak · 2023-10-13T09:59:31Z

- otherClasses.forEach((clazz) => {
- def[clazz.name] = makeNodeErrorWithCode(clazz, sym);
- });
+ if (otherClasses.includes(HideStackFramesError)) {


@mcollina
@anonrig
Should we use primordials?

I would recommend we do.

Uzlopak · 2023-10-14T02:08:06Z

@benjamingr
Can you have a look?

benjamingr

Don't have capacity, sorry, unblocking so others can progress

unavailable

Uzlopak · 2023-10-15T18:19:44Z

@anonrig
Can you now add the author-ready tag, please?

nodejs-github-bot · 2023-10-15T18:27:53Z

CI: https://ci.nodejs.org/job/node-test-pull-request/54832/

Uzlopak · 2023-10-15T22:26:02Z

@anonrig
can you retrigger the failed CI,please?

nodejs-github-bot · 2023-10-15T23:28:57Z

CI: https://ci.nodejs.org/job/node-test-pull-request/54837/

nodejs-github-bot · 2023-10-23T16:47:42Z

CI: https://ci.nodejs.org/job/node-test-pull-request/55153/

nodejs-github-bot · 2023-11-02T13:07:16Z

CI: https://ci.nodejs.org/job/node-test-pull-request/55419/ 💛

mcollina

lgtm

nodejs-github-bot · 2023-11-11T16:25:10Z

Landed in 83e6350

PR-URL: #49990 Reviewed-By: Matteo Collina <matteo.collina@gmail.com> Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com> Reviewed-By: James M Snell <jasnell@gmail.com>

nodejs-github-bot added lib / src Issues and PRs related to general changes in the lib or src directory. needs-ci PRs that need a full CI run. labels Oct 1, 2023

Uzlopak mentioned this pull request Oct 1, 2023
Node errors are very slow to create nodejs/performance#40
Open

benjamingr reviewed Oct 1, 2023
View reviewed changes

Uzlopak force-pushed the hidestack-frames branch from cd3b2c9 to a12addeCompare October 1, 2023 22:39

Uzlopak force-pushed the hidestack-frames branch 4 times, most recently from a2134fc to 3f94be4Compare October 4, 2023 20:11

anonrig added the request-ci Add this label to start a Jenkins CI on a PR. label Oct 4, 2023

anonrig requested review from benjamingr and mcollina October 4, 2023 20:24

github-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Oct 4, 2023

tniessen added the review wanted PRs that need reviews. label Oct 4, 2023

github-actionsBot mentioned this pull request Oct 5, 2023
CI Reliability 2023-10-05 nodejs/reliability#684
Open
13 tasks

Uzlopak force-pushed the hidestack-frames branch 3 times, most recently from da8ff55 to 134ea2bCompare October 5, 2023 12:05

mcollina approved these changes Oct 5, 2023
View reviewed changes

Qard reviewed Oct 5, 2023
View reviewed changes

Comment threadlib/internal/errors.js Outdated

github-actionsBot mentioned this pull request Oct 6, 2023
CI Reliability 2023-10-06 nodejs/reliability#685
Open
10 tasks

Uzlopak commented Oct 13, 2023
View reviewed changes

benjamingr reviewed Oct 14, 2023
View reviewed changes

Uzlopak requested review from Qard and RafaelGSS October 14, 2023 20:35

anonrig added author ready PRs that have at least one approval, no pending requests for changes, and a CI started. request-ci Add this label to start a Jenkins CI on a PR. labels Oct 15, 2023

github-actionsBot removed the request-ci Add this label to start a Jenkins CI on a PR. label Oct 15, 2023

mcollina approved these changes Nov 2, 2023
View reviewed changes

jasnell approved these changes Nov 11, 2023
View reviewed changes

jasnell added the commit-queue Add this label to land a pull request using GitHub Actions. label Nov 11, 2023

nodejs-github-bot removed the commit-queue Add this label to land a pull request using GitHub Actions. label Nov 11, 2023

nodejs-github-bot merged commit 83e6350 into nodejs:mainNov 11, 2023

targos pushed a commit that referenced this pull request Nov 11, 2023
errors: improve hideStackFrames
6c3a3c1
PR-URL: #49990 Reviewed-By: Matteo Collina <matteo.collina@gmail.com> Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com> Reviewed-By: James M Snell <jasnell@gmail.com>

targos mentioned this pull request Nov 12, 2023
v21.2.0 release proposal #50681
Merged

Uzlopak deleted the hidestack-frames branch November 13, 2023 07:42

targos pushed a commit that referenced this pull request Nov 14, 2023
errors: improve hideStackFrames
14e3675
PR-URL: #49990 Reviewed-By: Matteo Collina <matteo.collina@gmail.com> Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com> Reviewed-By: James M Snell <jasnell@gmail.com>

PavelMor25 mentioned this pull request Nov 15, 2023
fix test-server test: incorrect socket hang up processing error in Node v21 DevExpress/testcafe-hammerhead#2978
Merged

richardlau pushed a commit that referenced this pull request Mar 25, 2024
errors: improve hideStackFrames
db7459b
PR-URL: #49990 Reviewed-By: Matteo Collina <matteo.collina@gmail.com> Reviewed-By: Yagiz Nizipli <yagiz@nizipli.com> Reviewed-By: James M Snell <jasnell@gmail.com>

richardlau mentioned this pull request Mar 25, 2024
v20.12.0 proposal #52212
Merged

Uh oh!

Uh oh!

Conversation

Uzlopak commented Oct 1, 2023• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nodejs-github-bot commented Oct 1, 2023

Uh oh!

mcollina commented Oct 1, 2023

Uh oh!

Uzlopak commented Oct 1, 2023

Uh oh!

benjamingrOct 1, 2023• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

UzlopakOct 1, 2023

Choose a reason for hiding this comment

Uh oh!

benjamingrOct 5, 2023

Choose a reason for hiding this comment

Uh oh!

UzlopakOct 8, 2023

Choose a reason for hiding this comment

Uh oh!

Uzlopak commented Oct 2, 2023

Uh oh!

Uzlopak commented Oct 2, 2023

Uh oh!

Uzlopak commented Oct 4, 2023

Uh oh!

anonrig commented Oct 4, 2023

Uh oh!

nodejs-github-bot commented Oct 4, 2023

Uh oh!

targos commented Oct 5, 2023

Uh oh!

mcollina left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

mcollina commented Oct 13, 2023

Uh oh!

UzlopakOct 13, 2023

Choose a reason for hiding this comment

Uh oh!

UzlopakOct 13, 2023

Choose a reason for hiding this comment

Uh oh!

mcollinaOct 26, 2023

Choose a reason for hiding this comment

Uh oh!

Uzlopak commented Oct 14, 2023

Uh oh!

benjamingr left a comment

Choose a reason for hiding this comment

Uh oh!

Uzlopak commented Oct 15, 2023• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nodejs-github-bot commented Oct 15, 2023

Uh oh!

Uzlopak commented Oct 15, 2023

Uh oh!

nodejs-github-bot commented Oct 15, 2023

Uh oh!

nodejs-github-bot commented Oct 23, 2023

Uh oh!

nodejs-github-bot commented Nov 2, 2023• edited by jasnell Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

mcollina left a comment

Choose a reason for hiding this comment

Uh oh!

nodejs-github-bot commented Nov 11, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Uzlopak commented Oct 1, 2023•
edited
Loading

benjamingrOct 1, 2023•
edited
Loading

Uzlopak commented Oct 15, 2023•
edited
Loading

nodejs-github-bot commented Nov 2, 2023•
edited by jasnell
Loading