Skip to content

buffer: refactor buffer exports - #13807

Closed
jasnell wants to merge 1 commit into
nodejs:masterfrom
jasnell:refactor-buffer
Closed

buffer: refactor buffer exports#13807
jasnell wants to merge 1 commit into
nodejs:masterfrom
jasnell:refactor-buffer

Conversation

@jasnell

@jasnelljasnell commented Jun 20, 2017

Copy link
Copy Markdown
Member
Checklist
  • make -j4 test (UNIX), or vcbuild test (Windows) passes
  • tests and/or benchmarks are included
  • commit message follows commit guidelines
Affected core subsystem(s)

buffer

@jasnelljasnell added the semver-major PRs that contain breaking changes and should be released in the next major version. label Jun 20, 2017
@nodejs-github-botnodejs-github-bot added buffer Issues and PRs related to the buffer subsystem. errors Issues and PRs related to JavaScript errors originated in Node.js core. labels Jun 20, 2017
Comment threadlib/buffer.js Outdated

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Typo

@Trott

Copy link
Copy Markdown
Member

lib/buffer.js currently has 100% code coverage in our test suite. If not too onerous, it would be nice to run the coverage report on this PR to make sure the refactoring doesn't introduce code paths that are now untested.

Comment threadlib/buffer.js Outdated

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd prefer using buf1 instead of a in the code as well.

Comment threadlib/internal/buffer.js Outdated

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would { FastBuffer: undefined } make it more self-documenting?

Comment threadlib/internal/errors.js Outdated

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Alphabetical order.

@jasnelljasnell added the wip Issues and PRs that are still a work in progress. label Jun 20, 2017
@jasnell

Copy link
Copy Markdown
MemberAuthor

Forgot to mark this as in progress as I still need to add the documentation updates for the new error codes...

Comment threadlib/internal/errors.js Outdated

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe call the error type something more generic? There could be any variable that may not be negative or that may not be greater than x.

Comment threadlib/internal/errors.js Outdated

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am not sure if the error codes should be more generic or not but I think it would make sense if they are. In this case the ERR_INVALID_OPT_VALUE type could also be used as such.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IMHO including the encoding name is better.

Comment threadlib/internal/errors.js Outdated

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See my comment below. This type is at least redundant to ERR_UNKNOWN_ENCODING but I would use ERR_INVALID_OPT_VALUE instead.

Comment threadlib/internal/errors.js Outdated

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure if these types would only fit for buffers and therefore I recommend to remove the BUFFER part from the name.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There's the whole over specialization of invalid options debate:

try{// do some stuffvarf=fs.openSync('g.txt','rgh');// do other stuffcatch(e){if(e.code=='ERR_INVALID_OPT_VALUE')console.error(e)&&process.exit(1)// because it's a programming errorelse ...;}

Maybe worth creating a new type? OptionError, or have all the codes include a substring?

Comment threadlib/internal/errors.js Outdated

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This could be consolidated with ERR_ARG_OUT_OF_BOUNDS even though it's not as specific.

@refackrefack left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overspecialization of error codes should be discussed

Comment threadlib/internal/errors.js Outdated

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There's the whole over specialization of invalid options debate:

try{// do some stuffvarf=fs.openSync('g.txt','rgh');// do other stuffcatch(e){if(e.code=='ERR_INVALID_OPT_VALUE')console.error(e)&&process.exit(1)// because it's a programming errorelse ...;}

Maybe worth creating a new type? OptionError, or have all the codes include a substring?

@jasnell

Copy link
Copy Markdown
MemberAuthor

Over-generalization of error codes will make those fairly useless and users will end up parsing the error messages again to find out what actually happened. There's little harm in having specific error codes.

@refack

Copy link
Copy Markdown
Contributor

Over-generalization of error codes will make those fairly useless and users will end up parsing the error messages again to find out what actually happened. There's little harm in having specific error codes.

I suggested two solutions: Either create an OptionError type, or use the a prefix ERR_INVALID_OPT_VALUE_XXX.
My main point is that these are predominantly programing errors and less often runtime errors.

@refack

Copy link
Copy Markdown
Contributor

Superseded by #13976

@refackrefack closed this Jul 15, 2017
@jasnell

Copy link
Copy Markdown
MemberAuthor

This is not fully superseded. I will refactor. Please do not close.

@jasnelljasnell reopened this Jul 17, 2017
* Move to more efficient module.exports pattern
* Refactor requires
* Eliminate circular dependency on internal/buffer
* Add names to some functions
* Fix circular dependency error in assert.js
@jasnell

Copy link
Copy Markdown
MemberAuthor

Updated. I was waiting for #13976 to land so I could drop the internal/errors commit and refactor this. It should be good to go now.

@jasnelljasnell changed the title buffer: refactor buffer exports, use internal/errorsbuffer: refactor buffer exportsJul 18, 2017

@refackrefack left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would like to see obfuscated whiles replaced with for...

Comment threadlib/buffer.js
var i = 0;
while (++i < byteLength && (mul *= 0x100))
val += this[offset + i] * mul;
var val = this[offset];

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we're churning let's get some butter: replace with for(...;...;...) to make it more readable. Performance should be on par

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm going to leave these for now. We can hit those in a separate PR

@refack

refack commented Jul 18, 2017

Copy link
Copy Markdown
Contributor

So I would like to see the obfuscated whiles replaced with for but that might be outside of this PR intended scope...

@refackrefack removed the wip Issues and PRs that are still a work in progress. label Jul 18, 2017
@refack

Copy link
Copy Markdown
Contributor

Updated. I was waiting for #13976 to land so I could drop the internal/errors commit and refactor this. It should be good to go now.

@jasnell I'm assuming this is not in progress anymore? Also AFAICT it's semver-patch with the Error changes removed.

@jasnelljasnell removed semver-major PRs that contain breaking changes and should be released in the next major version. errors Issues and PRs related to JavaScript errors originated in Node.js core. labels Jul 24, 2017
@jasnell

Copy link
Copy Markdown
MemberAuthor

@jasnell

Copy link
Copy Markdown
MemberAuthor

CI is green.

jasnell added a commit that referenced this pull request Jul 24, 2017
* Move to more efficient module.exports pattern
* Refactor requires
* Eliminate circular dependency on internal/buffer
* Add names to some functions
* Fix circular dependency error in assert.js
PR-URL: #13807
Reviewed-By: Refael Ackermann <refack@gmail.com>
@jasnell

Copy link
Copy Markdown
MemberAuthor

Landed in 355523f

@jasnelljasnell closed this Jul 24, 2017
@addaleax

Copy link
Copy Markdown
Member

This doesn’t land cleanly on 8.x; if you can, please follow the guide and raise a backport PR, if you don’t think it’s worth it let me know and we’ll add the dont-land-on label.

@jasnell

Copy link
Copy Markdown
MemberAuthor

Unless it causes pain for backporting other things, this is not a priority to backport.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bufferIssues and PRs related to the buffer subsystem.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants

@jasnell@Trott@refack@addaleax@mscdex@TimothyGu@BridgeAR@MylesBorins@nodejs-github-bot