Skip to content

Make Signature monomorphic - #59192

Closed
Titian Cernicova-Dragomir (dragomirtitian) wants to merge 1 commit into
microsoft:mainfrom
bloomberg:experiment-monomorphic-signature
Closed

Make Signature monomorphic#59192
Titian Cernicova-Dragomir (dragomirtitian) wants to merge 1 commit into
microsoft:mainfrom
bloomberg:experiment-monomorphic-signature

Conversation

@dragomirtitian

Copy link
Copy Markdown
Contributor

Part of #58928 - Only make signatures monomorphic.

@typescript-botTypeScript Bot (typescript-bot) added the For Uncommitted Bug PR for untriaged, rejected, closed or missing bug label Jul 8, 2024
@jakebailey

Copy link
Copy Markdown
Member

TypeScript Bot (@typescript-bot) perf test this

@typescript-bot

TypeScript Bot (typescript-bot) commented Jul 8, 2024

Copy link
Copy Markdown
Contributor

Starting jobs; this comment will be updated as builds start and complete.

CommandStatusResults
perf test this✅ Started👀 Results

@typescript-bot

Copy link
Copy Markdown
Contributor

Jake Bailey (@jakebailey)
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
MetricbaselineprDeltaBestWorstp-value
Compiler-Unions - node (v18.15.0, x64)
Errors3030~~~p=1.000 n=6
Symbols62,15362,153~~~p=1.000 n=6
Types50,24250,242~~~p=1.000 n=6
Memory used193,434k (± 0.94%)193,349k (± 0.94%)~192,087k195,686kp=0.298 n=6
Parse Time1.30s (± 0.40%)1.30s (± 0.63%)~1.29s1.31sp=0.929 n=6
Bind Time0.71s0.71s~~~p=1.000 n=6
Check Time9.46s (± 0.34%)9.41s (± 0.27%)-0.05s (- 0.56%)9.39s9.45sp=0.019 n=6
Emit Time2.75s (± 0.63%)2.73s (± 0.45%)~2.72s2.75sp=0.188 n=6
Total Time14.22s (± 0.25%)14.16s (± 0.14%)-0.06s (- 0.45%)14.13s14.18sp=0.013 n=6
angular-1 - node (v18.15.0, x64)
Errors55~~~p=1.000 n=6
Symbols944,114944,114~~~p=1.000 n=6
Types407,050407,050~~~p=1.000 n=6
Memory used1,218,377k (± 0.00%)1,217,450k (± 0.00%)-927k (- 0.08%)1,217,400k1,217,506kp=0.005 n=6
Parse Time7.99s (± 0.82%)7.98s (± 0.30%)~7.95s8.01sp=0.935 n=6
Bind Time2.23s (± 0.55%)2.24s (± 0.77%)~2.22s2.26sp=0.157 n=6
Check Time35.90s (± 0.44%)35.28s (± 0.44%)-0.62s (- 1.72%)35.14s35.53sp=0.005 n=6
Emit Time16.18s (± 0.29%)16.14s (± 0.88%)~15.93s16.35sp=0.296 n=6
Total Time62.29s (± 0.26%)61.63s (± 0.23%)-0.66s (- 1.06%)61.48s61.88sp=0.005 n=6
mui-docs - node (v18.15.0, x64)
Errors00~~~p=1.000 n=6
Symbols2,130,3432,130,343~~~p=1.000 n=6
Types927,684927,684~~~p=1.000 n=6
Memory used2,107,262k (± 0.00%)2,106,585k (± 0.00%)-677k (- 0.03%)2,106,545k2,106,627kp=0.005 n=6
Parse Time6.62s (± 0.32%)6.62s (± 0.35%)~6.58s6.64sp=0.623 n=6
Bind Time2.33s (± 0.42%)2.32s (± 0.35%)~2.31s2.33sp=0.181 n=6
Check Time70.79s (± 0.45%)70.48s (± 0.31%)~70.17s70.77sp=0.065 n=6
Emit Time0.13s (± 3.87%)0.14s (± 4.05%)~0.13s0.14sp=0.640 n=6
Total Time79.87s (± 0.39%)79.56s (± 0.29%)-0.31s (- 0.39%)79.27s79.85sp=0.044 n=6
self-build-src - node (v18.15.0, x64)
Errors00~~~p=1.000 n=6
Symbols1,225,5881,226,038+450 (+ 0.04%)~~p=0.001 n=6
Types261,474261,486+12 (+ 0.00%)~~p=0.001 n=6
Memory used2,341,817k (± 0.03%)2,341,437k (± 0.07%)~2,339,612k2,343,777kp=0.575 n=6
Parse Time6.02s (± 0.79%)6.05s (± 0.91%)~5.99s6.13sp=0.575 n=6
Bind Time2.25s (± 0.46%)2.26s (± 0.67%)~2.24s2.28sp=0.517 n=6
Check Time40.37s (± 0.81%)39.69s (± 0.86%)-0.68s (- 1.68%)39.27s40.24sp=0.013 n=6
Emit Time3.05s (± 2.91%)3.20s (± 1.42%)🔻+0.15s (+ 4.80%)3.14s3.27sp=0.013 n=6
Total Time51.73s (± 0.86%)51.22s (± 0.68%)~50.85s51.76sp=0.066 n=6
self-build-src-public-api - node (v18.15.0, x64)
Errors00~~~p=1.000 n=6
Symbols1,225,5881,226,038+450 (+ 0.04%)~~p=0.001 n=6
Types261,474261,486+12 (+ 0.00%)~~p=0.001 n=6
Memory used2,415,051k (± 0.03%)2,417,086k (± 0.18%)~2,413,763k2,422,674kp=0.936 n=6
Parse Time5.20s (± 1.08%)5.19s (± 0.90%)~5.13s5.26sp=0.748 n=6
Bind Time1.70s (± 0.61%)1.69s (± 0.48%)~1.68s1.70sp=0.112 n=6
Check Time34.60s (± 0.30%)34.05s (± 0.33%)-0.54s (- 1.57%)33.89s34.17sp=0.005 n=6
Emit Time2.69s (± 5.31%)2.71s (± 2.43%)~2.63s2.82sp=0.128 n=6
Total Time44.18s (± 0.48%)43.66s (± 0.32%)-0.52s (- 1.17%)43.48s43.81sp=0.005 n=6
self-compiler - node (v18.15.0, x64)
Errors00~~~p=1.000 n=6
Symbols258,188258,235+47 (+ 0.02%)~~p=0.001 n=6
Types104,737104,744+7 (+ 0.01%)~~p=0.001 n=6
Memory used427,463k (± 0.01%)427,322k (± 0.01%)-141k (- 0.03%)427,270k427,373kp=0.005 n=6
Parse Time2.71s (± 0.71%)2.70s (± 1.86%)~2.60s2.75sp=0.935 n=6
Bind Time1.10s (± 1.24%)1.11s (± 2.70%)~1.09s1.17sp=0.370 n=6
Check Time15.14s (± 0.33%)14.88s (± 0.36%)-0.26s (- 1.72%)14.81s14.97sp=0.005 n=6
Emit Time1.07s (± 1.84%)1.06s (± 1.73%)~1.04s1.09sp=0.564 n=6
Total Time20.01s (± 0.35%)19.74s (± 0.30%)-0.27s (- 1.35%)19.67s19.82sp=0.005 n=6
ts-pre-modules - node (v18.15.0, x64)
Errors3535~~~p=1.000 n=6
Symbols224,565224,565~~~p=1.000 n=6
Types93,73493,734~~~p=1.000 n=6
Memory used369,561k (± 0.04%)369,300k (± 0.02%)-261k (- 0.07%)369,181k369,373kp=0.005 n=6
Parse Time2.31s (± 0.45%)2.30s (± 0.93%)~2.26s2.32sp=0.211 n=6
Bind Time1.32s (± 0.57%)1.32s (± 1.48%)~1.29s1.35sp=0.672 n=6
Check Time13.14s (± 0.19%)12.87s (± 0.25%)-0.27s (- 2.04%)12.81s12.90sp=0.005 n=6
Emit Time0.00s0.00s~~~p=1.000 n=6
Total Time16.77s (± 0.13%)16.49s (± 0.27%)-0.29s (- 1.72%)16.44s16.54sp=0.005 n=6
vscode - node (v18.15.0, x64)
Errors00~~~p=1.000 n=6
Symbols2,884,9102,884,910~~~p=1.000 n=6
Types976,550976,550~~~p=1.000 n=6
Memory used3,047,989k (± 0.00%)3,046,090k (± 0.00%)-1,899k (- 0.06%)3,046,056k3,046,192kp=0.005 n=6
Parse Time16.88s (± 0.16%)16.93s (± 0.09%)+0.05s (+ 0.31%)16.90s16.94sp=0.010 n=6
Bind Time5.12s (± 2.01%)5.13s (± 1.81%)~5.06s5.31sp=0.872 n=6
Check Time91.71s (± 2.83%)89.22s (± 2.12%)~87.92s92.83sp=0.066 n=6
Emit Time26.89s (± 9.23%)28.20s (± 6.75%)~24.59s29.44sp=0.377 n=6
Total Time140.60s (± 0.14%)139.47s (± 0.21%)-1.13s (- 0.80%)139.16s139.98sp=0.005 n=6
webpack - node (v18.15.0, x64)
Errors00~~~p=1.000 n=6
Symbols267,117267,117~~~p=1.000 n=6
Types108,775108,775~~~p=1.000 n=6
Memory used411,617k (± 0.02%)411,235k (± 0.01%)-382k (- 0.09%)411,187k411,323kp=0.005 n=6
Parse Time4.70s (± 0.59%)4.69s (± 0.29%)~4.66s4.70sp=0.460 n=6
Bind Time2.07s (± 0.56%)2.08s (± 0.80%)~2.06s2.10sp=0.222 n=6
Check Time20.77s (± 0.44%)20.44s (± 0.39%)-0.33s (- 1.57%)20.35s20.55sp=0.005 n=6
Emit Time0.00s0.00s~~~p=1.000 n=6
Total Time27.54s (± 0.44%)27.21s (± 0.32%)-0.33s (- 1.19%)27.12s27.34sp=0.005 n=6
xstate-main - node (v18.15.0, x64)
Errors00~~~p=1.000 n=6
Symbols525,251525,251~~~p=1.000 n=6
Types178,574178,574~~~p=1.000 n=6
Memory used462,616k (± 0.05%)462,641k (± 0.07%)~462,210k462,979kp=0.936 n=6
Parse Time3.93s (± 0.41%)3.94s (± 0.71%)~3.91s3.97sp=0.870 n=6
Bind Time1.45s (± 0.68%)1.45s (± 0.62%)~1.44s1.46sp=0.931 n=6
Check Time22.17s (± 0.46%)22.03s (± 0.55%)~21.91s22.20sp=0.093 n=6
Emit Time0.00s0.00s (±154.76%)~0.00s0.01sp=0.174 n=6
Total Time27.55s (± 0.35%)27.42s (± 0.41%)~27.31s27.57sp=0.127 n=6
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • Compiler-Unions - node (v18.15.0, x64)
  • angular-1 - node (v18.15.0, x64)
  • mui-docs - node (v18.15.0, x64)
  • self-build-src - node (v18.15.0, x64)
  • self-build-src-public-api - node (v18.15.0, x64)
  • self-compiler - node (v18.15.0, x64)
  • ts-pre-modules - node (v18.15.0, x64)
  • vscode - node (v18.15.0, x64)
  • webpack - node (v18.15.0, x64)
  • xstate-main - node (v18.15.0, x64)
BenchmarkNameIterations
Currentpr6
Baselinebaseline6

tsserver

Comparison Report - baseline..pr
MetricbaselineprDeltaBestWorstp-value
Compiler-UnionsTSServer - node (v18.15.0, x64)
Req 1 - updateOpen2,915ms (± 9.64%)2,880ms (± 9.19%)~2,743ms3,419msp=0.748 n=6
Req 2 - geterr6,950ms (± 9.50%)7,108ms (± 6.97%)~6,097ms7,352msp=0.471 n=6
Req 3 - references369ms (±10.44%)371ms (±10.46%)~321ms402msp=0.683 n=6
Req 4 - navto340ms (± 0.55%)329ms (± 7.60%)~279ms342msp=0.567 n=6
Req 5 - completionInfo count1,3571,357~~~p=1.000 n=6
Req 5 - completionInfo131ms (± 0.39%)132ms (± 2.51%)~130ms139msp=0.928 n=6
CompilerTSServer - node (v18.15.0, x64)
Req 1 - updateOpen3,562ms (± 0.57%)3,598ms (± 1.26%)~3,548ms3,672msp=0.173 n=6
Req 2 - geterr5,551ms (± 0.77%)5,446ms (± 0.72%)-105ms (- 1.88%)5,399ms5,510msp=0.008 n=6
Req 3 - references413ms (± 0.52%)413ms (± 0.18%)~412ms414msp=0.397 n=6
Req 4 - navto334ms (± 0.62%)336ms (± 0.56%)~334ms339msp=0.210 n=6
Req 5 - completionInfo count1,5191,519~~~p=1.000 n=6
Req 5 - completionInfo109ms (± 2.95%)108ms (± 2.61%)~102ms109msp=0.090 n=6
xstate-main-1-tsserver - node (v18.15.0, x64)
Req 1 - updateOpen5,187ms (± 0.66%)5,195ms (± 0.38%)~5,166ms5,212msp=0.936 n=6
Req 2 - geterr1,124ms (± 1.19%)1,127ms (± 1.52%)~1,100ms1,147msp=0.689 n=6
Req 3 - references76ms (± 3.67%)76ms (± 3.15%)~75ms81msp=1.000 n=6
Req 4 - navto457ms (± 0.14%)457ms (± 0.51%)~456ms462msp=0.485 n=6
Req 5 - completionInfo count3,4133,413~~~p=1.000 n=6
Req 5 - completionInfo833ms (± 1.86%)827ms (± 1.52%)~809ms843msp=0.689 n=6
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • CompilerTSServer - node (v18.15.0, x64)
  • Compiler-UnionsTSServer - node (v18.15.0, x64)
  • xstate-main-1-tsserver - node (v18.15.0, x64)
BenchmarkNameIterations
Currentpr6
Baselinebaseline6

startup

Comparison Report - baseline..pr
MetricbaselineprDeltaBestWorstp-value
tsc-startup - node (v18.15.0, x64)
Execution time187.57ms (± 0.17%)187.69ms (± 0.20%)+0.12ms (+ 0.06%)185.91ms193.38msp=0.006 n=600
tsserver-startup - node (v18.15.0, x64)
Execution time230.74ms (± 0.14%)231.09ms (± 0.15%)+0.36ms (+ 0.16%)229.56ms238.01msp=0.000 n=600
tsserverlibrary-startup - node (v18.15.0, x64)
Execution time226.17ms (± 0.14%)226.34ms (± 0.15%)+0.17ms (+ 0.08%)224.78ms230.61msp=0.000 n=600
typescript-startup - node (v18.15.0, x64)
Execution time334.89ms (± 0.30%)335.10ms (± 0.31%)+0.21ms (+ 0.06%)326.96ms343.11msp=0.000 n=600
System info unknown
Hosts
  • node (v18.15.0, x64)
Scenarios
  • tsc-startup - node (v18.15.0, x64)
  • tsserver-startup - node (v18.15.0, x64)
  • tsserverlibrary-startup - node (v18.15.0, x64)
  • typescript-startup - node (v18.15.0, x64)
BenchmarkNameIterations
Currentpr6
Baselinebaseline6

Developer Information:

Download Benchmarks

Sign up for freeto subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

For Uncommitted BugPR for untriaged, rejected, closed or missing bug

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@dragomirtitian@jakebailey@typescript-bot@RyanCavanaugh