Uh oh!
There was an error while loading. Please reload this page.
Enable JS emit for noCheck and noCheck for transpileModule - #58364
Merged
Wesley Wigham (weswigham) merged 7 commits intoMay 30, 2024
Conversation
Wesley Wigham (weswigham)
commented
Apr 29, 2024
MemberAuthor
TypeScript Bot (@typescript-bot) perf test this faster |
Contributor
TypeScript Bot (typescript-bot)
commented
Apr 29, 2024
Contributor
Wesley Wigham (@weswigham) Here they are:tscComparison Report - baseline..pr
System info unknown Hosts
Scenarios
Developer Information: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| !!!! File file1.js missing from original emit, but present in noCheck emit | ||
| //// [file1.js] | ||
| export const x = 3; |
MemberAuthor
There was a problem hiding this comment.
No checker error, so the emit happens. 🤷♂️
| } | ||
| declare var k: c | m.c; | ||
| -declare var l: c | m.c; | ||
| +declare var l: m.c | c; |
MemberAuthor
There was a problem hiding this comment.
Union order swaps - the EmitResolver during js+.d.ts emit happens to create these types in the reverse order of a full typecheck.
| !!! related TS2304 multiLinePropertyAccessAndArrowFunctionIndent1.ts:1:18: Cannot find name 'role'. | ||
| !!! related TS2304 multiLinePropertyAccessAndArrowFunctionIndent1.ts:2:18: Cannot find name 'Role'. | ||
| !!! related TS2503 multiLinePropertyAccessAndArrowFunctionIndent1.ts:4:26: Cannot find namespace 'ng'. | ||
| !!! related TS2304 multiLinePropertyAccessAndArrowFunctionIndent1.ts:4:53: Cannot find name 'Role'. |
MemberAuthor
There was a problem hiding this comment.
The top-level return is a grammar error that normally blocks us reporting all these errors. Calculating emit flags for them lazily, however, manifests these errors. Do note: this is also technically a correctness improvement - previously, block scoped bindings and the like inside a top-level return like this wouldn't get transformed according to the target because we'd assume we'd calculated their NodeCheckFlags when in fact we hadn't. Still, these errors are basically silent, even if they're reasonable, hence the warning in the error log. I could probably silence these and get the old behavior back if I really tried, I'm just not sure it's necessary.
| !!!! File all.d.ts missing from original emit, but present in noCheck emit | ||
| //// [all.d.ts] | ||
| declare module "ref/a" { |
MemberAuthor
There was a problem hiding this comment.
Now that this isn't emitDeclarationOnly, this configuration of compiler options is forbidden, thus produces no output again. (Even with noCheck)
| declare function concat2<T extends readonly unknown[], U extends readonly unknown[]>(t: T, u: U): (T[number] | U[number])[]; | ||
| -declare const tc5: (2 | 4 | 1 | 3 | 6 | 5)[]; | ||
| +declare const tc5: (1 | 2 | 3 | 6 | 4 | 5)[]; | ||
| +declare const tc5: (3 | 2 | 1 | 6 | 4 | 5)[]; |
MemberAuthor
There was a problem hiding this comment.
This union order shifts again. Presumably the EmitResolver usages in js emit tweak the order we manifest these number types in.
| !!!! File autoAccessor1.js missing from original emit, but present in noCheck emit | ||
| //// [autoAccessor1.js] | ||
| var __classPrivateFieldGet = (this && this.__classPrivateFieldGet) || function (receiver, state, kind, f) { |
MemberAuthor
There was a problem hiding this comment.
The target error for auto-accessors, Properties with the 'accessor' modifier are only available when targeting ECMAScript 2015 and higher. is a checker error. So when it's suppressed, we happily do emit.
Wesley Wigham (weswigham)force-pushed
the
nocheck-js-emit
branch
from
April 30, 2024 01:21
699039b to
6e919adCompareWesley Wigham (weswigham)force-pushed
the
nocheck-js-emit
branch
from
May 14, 2024 21:32
8ecd6bf to
f3eab73Compare| "use strict"; | ||
| Object.defineProperty(exports, "__esModule", { value: true }); | ||
| -exports.a = void 0; | ||
| -exports.a = x.c; |
MemberAuthor
There was a problem hiding this comment.
I think this is a case where the noCheck output is an improvement. As a perf optimization, I made reference marking with an Unspecified hint skip all Ambient nodes - that causes this change. The export declare import statement in this file usually gets transformed into the output js, even though it has a declare modifier. That's likely because the declare modifier on an import is an error, so the alias marking is done unconditionally. In any case, since the input has a syntax/grammar type error, I think it's fine for the output to diverge a bit like this. I could bring it in-line (either by changing normal behavior to elide this, or noCheck to retain it), but I'm not sure it's worth the effort, given the error.
Wesley Wigham (weswigham)
commented
May 14, 2024
MemberAuthor
TypeScript Bot (@typescript-bot) perf test this faster I still need to sprinkle around setting the |
Contributor
TypeScript Bot (typescript-bot)
commented
May 14, 2024
Contributor
Wesley Wigham (@weswigham) Here they are:tscComparison Report - baseline..pr
System info unknown Hosts
Scenarios
Developer Information: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Wesley Wigham (weswigham)
commented
May 14, 2024
MemberAuthor
Much better, no more check regressions, only emit ones, and those aughta get fixed with proper application of |
Wesley Wigham (weswigham)
commented
May 15, 2024
MemberAuthor
TypeScript Bot (@typescript-bot) perf test this faster |
Contributor
TypeScript Bot (typescript-bot)
commented
May 15, 2024
Contributor
Wesley Wigham (@weswigham) Here they are:tscComparison Report - baseline..pr
System info unknown Hosts
Scenarios
Developer Information: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Wesley Wigham (weswigham)
commented
May 15, 2024
MemberAuthor
TypeScript Bot (@typescript-bot) perf test this faster |
Contributor
TypeScript Bot (typescript-bot)
commented
May 15, 2024
Contributor
Wesley Wigham (@weswigham) Here they are:tscComparison Report - baseline..pr
System info unknown Hosts
Scenarios
Developer Information: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| isReferencedAliasDeclaration(node: Node, checkChildren?: boolean): boolean; | ||
| isTopLevelValueImportEqualsWithEntityName(node: ImportEqualsDeclaration): boolean; | ||
| getNodeCheckFlags(node: Node): NodeCheckFlags; | ||
| hasNodeCheckFlag(node: Node, flags: LazyNodeCheckFlags): boolean; |
There was a problem hiding this comment.
All in all, I wonder how many other flag checks could be done like this (I did something similar for another flag which helped perf too)
Jake Bailey (jakebailey)
commented
May 16, 2024
Member
For fun TypeScript Bot (@typescript-bot) perf test this predictable |
Contributor
TypeScript Bot (typescript-bot)
commented
May 16, 2024
Contributor
Jake Bailey (@jakebailey) Here they are:tscComparison Report - baseline..pr
System info unknown Hosts
Scenarios
tsserverComparison Report - baseline..pr
System info unknown Hosts
Scenarios
startupComparison Report - baseline..pr
System info unknown Hosts
Scenarios
Developer Information: | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Jake Bailey (jakebailey)
commented
May 20, 2024
Member
TypeScript Bot (@typescript-bot) perf test this predictable |
Contributor
TypeScript Bot (typescript-bot)
commented
May 20, 2024
Contributor
Jake Bailey (@jakebailey) Here they are:tscComparison Report - baseline..pr
System info unknown Hosts
Scenarios
tsserverComparison Report - baseline..pr
System info unknown Hosts
Scenarios
startupComparison Report - baseline..pr
System info unknown Hosts
Scenarios
Developer Information: | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Jake Bailey (jakebailey)
commented
May 20, 2024
Member
The perf results are still seemingly showing a regression in emit time on various projects. Not sure what's going on there but I'll try and profile... |
Wesley Wigham (weswigham)
commented
May 20, 2024
MemberAuthor
I mentioned it in our meeting, but the only things not |
Sheetal Nandi (sheetalkamat) added a commit
that referenced
this pull request
May 21, 2024
…it to be done without type checking
| } | ||
| function markLinkedReferences(file: SourceFile) { | ||
| ts.forEachChildRecursively(file, n => { |
There was a problem hiding this comment.
can this instead check if file doesnt have TypeChecked flag and do this work and then we can get rid of getDiagnostics all together from getEmitResolver()
MemberAuthor
There was a problem hiding this comment.
Not quite - the TypeChecked flag is, ironically, set on files whose type checking is skipped. Maybe it's a misnomer, but it really just means "Has checkSourceFile been called on this node?". I get your drift though and, yeah, we could probably do a bit of refactoring to use a node flag to track the diagnostic walk state of the containing file. I'll probably put that up as a separate cleanup, though. I also think I want to move around/refactor the API logic for collectLinkedAliases so the API is harder to misuse, and will probably change markLinkedReferences to match, so I'll put all those nonfunctional changes in a separate PR (which should have a 0-test diff).
Uh oh!
There was an error while loading. Please reload this page.
Jake Bailey (jakebailey)
commented
May 24, 2024
Member
I'm having a pretty hard time figuring out where the slowdown is; the vscode benchmark takes a long time so two runs are just not comparable, even in predictable mode on a perf locked core. TypeScript Bot (@typescript-bot) perf test this faster |
Contributor
TypeScript Bot (typescript-bot)
commented
May 24, 2024
Contributor
Jake Bailey (@jakebailey) Here they are:tscComparison Report - baseline..pr
System info unknown Hosts
Scenarios
Developer Information: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| return !!(getNodeCheckFlags(node) & flag); | ||
| } | ||
| function calculateNodeCheckFlagWorker(node: Node, flag: LazyNodeCheckFlags) { |
There was a problem hiding this comment.
Is there a chance for this to go out of sync with other code that sets these flags?
MemberAuthor
There was a problem hiding this comment.
100% absolutely, but since we run with noCheck and compare the result to a normal emit for every test we have, it's very likely a test will catch it.
MemberAuthor
There was a problem hiding this comment.
I also do reuse the actual flag-setting functions, just not the traversal to reach and invoke them. So the "should this flag be set" logic should be synced, at least.
Member
TypeScript Bot (@typescript-bot) pack this |
Contributor
Contributor
Hey Daniel Rosenwasser (@DanielRosenwasser), I've packed this into an installable tgz. You can install it for testing by referencing it in your and then running There is also a playground for this build and an npm module you can use via |
Jake Bailey (jakebailey)
commented
May 24, 2024
Member
I thought I'd try this out on a ts-loader project, so tested out pyright's build before and after. Somehow, it's slower? I suppose this doesn't actually use transpileModule since they're using const enums and everything :( $ hyperfine 'node --max_old_space_size=8192 ./node_modules/webpack-cli/bin/cli.js --mode development'Benchmark 1: node --max_old_space_size=8192 ./node_modules/webpack-cli/bin/cli.js --mode development Time (mean ± σ): 14.899 s ± 0.221 s [User: 22.878 s, System: 1.591 s] Range (min … max): 14.379 s … 15.200 s 10 runs
$ hyperfine 'node --max_old_space_size=8192 ./node_modules/webpack-cli/bin/cli.js --mode development'Benchmark 1: node --max_old_space_size=8192 ./node_modules/webpack-cli/bin/cli.js --mode development Time (mean ± σ): 15.110 s ± 0.164 s [User: 23.219 s, System: 1.541 s] Range (min … max): 14.888 s … 15.395 s 10 runs |
Wesley Wigham (weswigham)
commented
May 24, 2024
MemberAuthor
Ya, |
Member
In lieu of real-world benchmarks, I used ts.transpileModule(input,{
fileName,compilerOptions: {target: ts.ScriptTarget.ESNext,module: ts.ModuleKind.Preserve}},);So, for files of a non-trivial size, it sure seems like a good 2x speed boost for I have not been able to pin down the perf regression, if there even is one. But I'm pretty sure we should just take this anyhow. |
Jake Bailey (jakebailey)
approved these changes
May 30, 2024
Jake Bailey (jakebailey)
left a comment
Member
There was a problem hiding this comment.
Looks good to me, though I'm not 100% thrilled with the increase in test time; it looks like it increases CI time from something like 7 minutes to 8.
Sheetal Nandi (sheetalkamat)
approved these changes
May 30, 2024
Jonathan Skeate (skeate) added a commit
to skeate/TypeScript
that referenced
this pull request
Jun 1, 2024
* upstream/main: (37 commits) Added NoTruncation flag to completions (microsoft#58719) Clone node to remove location even when it has been modified if needed (microsoft#58706) Properly account for `this` argument in intersection apparent type caching (microsoft#58677) Fix: Include Values of Script Extensions for Unicode Property Value Expressions in Regular Expressions (microsoft#58615) In `reScanSlashToken` use `charCodeChecked` not `codePointChecked` (microsoft#58727) Shorten error spans for errors reported on constructor declarations (microsoft#58061) Mark file as skips typechecking if it contains ts-nocheck (microsoft#58593) Fixed an issue with broken `await using` declarations in `for of` loops (microsoft#56466) Do not expand type references in keyof and index access (microsoft#58715) Improve the performance of isolatedDeclarations quickfix (microsoft#58722) Unwrap `NoInfer` types when narrowing (microsoft#58292) Recover from type reuse errors by falling back to inferred type printing (microsoft#58720) Fixing self import (microsoft#58718) Enable JS emit for noCheck and noCheck for transpileModule (microsoft#58364) Revert PR 55371 (microsoft#58702) Update dependencies (microsoft#58639) Fix baselines after PR 58621 (microsoft#58705) Do not infer `yield*` type from contextual `TReturn` (microsoft#58621) `await using` normative changes (microsoft#58624) Handling statements from a known source file (microsoft#58679) ...
5 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for freeto subscribe to this conversation on GitHub.
Already have an account?
Sign in.
5 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR enables
noCheckfor JS emit, and tests all js emit tests withnoCheck, just as we do declaration emit tests withnoCheck. It also enablesnoCheckfortranspileModuleby default.