Skip to content

ci: Fix overhead measurements runs on default branch - #7313

Merged
mydea merged 1 commit into
developfrom
fn/fix-metrics
Mar 1, 2023
Merged

ci: Fix overhead measurements runs on default branch#7313
mydea merged 1 commit into
developfrom
fn/fix-metrics

Conversation

@mydea

@mydeamydea commented Mar 1, 2023

Copy link
Copy Markdown
Member

Currently, it doesn't handle the fact that it runs the measurements on develop very well, and picks random PRs to add comments to 😬

@github-actions

Copy link
Copy Markdown
Contributor

Replay SDK metrics 🚀

Plain+Sentry+Replay
RevisionValueValueDiffRatioValueDiffRatio
LCPThis PR 69fbbbc63.57 ms62.67 ms-0.90 ms-1.42 %71.86 ms+8.29 ms+13.04 %
Baseline 8a5e0c387.70 ms76.81 ms-10.89 ms-12.42 %82.41 ms-5.29 ms-6.03 %
CLSThis PR 69fbbbc0.00 ms0.00 ms0.00 ms0.00 %0.25 ms+0.25 ms+5421.33 %
Baseline 8a5e0c30.00 ms0.00 ms0.00 ms0.00 %0.25 ms+0.25 ms+5395.74 %
CPUThis PR 69fbbbc18.65 %18.69 %+0.04 pp+0.23 %34.89 %+16.24 pp+87.12 %
Baseline 8a5e0c325.97 %26.29 %+0.33 pp+1.27 %44.57 %+18.61 pp+71.67 %
JS heap avgThis PR 69fbbbc3.54 MB6.93 MB+3.39 MB+95.67 %11.29 MB+7.75 MB+218.84 %
Baseline 8a5e0c33.47 MB5.81 MB+2.34 MB+67.51 %10.01 MB+6.55 MB+188.91 %
JS heap maxThis PR 69fbbbc3.9 MB8.34 MB+4.44 MB+113.77 %14.19 MB+10.29 MB+263.69 %
Baseline 8a5e0c33.89 MB7.65 MB+3.75 MB+96.49 %13.87 MB+9.98 MB+256.58 %
netTxThis PR 69fbbbc0 B360.44 kB+360.44 kBn/a105.65 kB+105.65 kBn/a
Baseline 8a5e0c30 B228.09 kB+228.09 kBn/a106.82 kB+106.82 kBn/a
netRxThis PR 69fbbbc18.1 kB17.45 kB-645 B-3.56 %18.16 kB+65 B+0.36 %
Baseline 8a5e0c317.17 kB18.18 kB+1.02 kB+5.91 %17.08 kB-84 B-0.49 %
netCountThis PR 69fbbbc12+1+100.00 %4+3+300.00 %
Baseline 8a5e0c312+1+100.00 %5+4+400.00 %
netTimeThis PR 69fbbbc538.43 ms802.53 ms+264.10 ms+49.05 %742.37 ms+203.94 ms+37.88 %
Baseline 8a5e0c3681.36 ms804.14 ms+122.78 ms+18.02 %793.97 ms+112.60 ms+16.53 %

Baseline results on branch: develop

RevisionLCPCLSCPUJS heap avgJS heap maxnetTxnetRxnetCountnetTime
3ba8e0b+11.39 ms+0.26 ms+18.59 pp+7.64 MB+10.42 MB+105.73 kB+332 B+3+67.85 ms
dbd7a81+98.37 ms-0.00 ms+6.68 pp+1.64 MB+1.82 MB+2.23 kB+41 B+1+124.71 ms
dbd7a81+86.19 ms-0.00 ms+6.77 pp+1.58 MB+1.67 MB+2.23 kB+41 B+1+87.99 ms
67b0684+84.74 ms-0.00 ms+7.38 pp+1.7 MB+1.81 MB+2.23 kB+41 B+1+85.52 ms
4b95c04+57.56 ms-0.00 ms+7.94 pp+920.88 kB+1.05 MB+2.21 kB+41 B+1+90.32 ms
e60cd02+56.25 ms-0.00 ms+6.32 pp+927.44 kB+1.06 MB+2.21 kB+41 B+1+117.55 ms
e25c067+48.34 ms+0.00 ms+5.59 pp+926.37 kB+1.05 MB+2.22 kB+41 B+1+65.23 ms
b1b249b+43.88 ms+0.00 ms+4.80 pp+937.99 kB+1.05 MB+2.22 kB+41 B+1+111.56 ms
12e34d4+28.57 ms+0.00 ms+5.77 pp+930.12 kB+1.04 MB+2.26 kB+41 B+1+109.67 ms

Previous results on branch: fn/fix-metrics

RevisionLCPCLSCPUJS heap avgJS heap maxnetTxnetRxnetCountnetTime
8a5e0c3-5.29 ms+0.25 ms+18.61 pp+6.55 MB+9.98 MB+106.82 kB-84 B+4+112.60 ms
3ba8e0b+11.39 ms+0.26 ms+18.59 pp+7.64 MB+10.42 MB+105.73 kB+332 B+3+67.85 ms
dbd7a81+98.37 ms-0.00 ms+6.68 pp+1.64 MB+1.82 MB+2.23 kB+41 B+1+124.71 ms
dbd7a81+86.19 ms-0.00 ms+6.77 pp+1.58 MB+1.67 MB+2.23 kB+41 B+1+87.99 ms
67b0684+84.74 ms-0.00 ms+7.38 pp+1.7 MB+1.81 MB+2.23 kB+41 B+1+85.52 ms
4b95c04+57.56 ms-0.00 ms+7.94 pp+920.88 kB+1.05 MB+2.21 kB+41 B+1+90.32 ms
e60cd02+56.25 ms-0.00 ms+6.32 pp+927.44 kB+1.06 MB+2.21 kB+41 B+1+117.55 ms
e25c067+48.34 ms+0.00 ms+5.59 pp+926.37 kB+1.05 MB+2.22 kB+41 B+1+65.23 ms
b1b249b+43.88 ms+0.00 ms+4.80 pp+937.99 kB+1.05 MB+2.22 kB+41 B+1+111.56 ms
12e34d4+28.57 ms+0.00 ms+5.77 pp+930.12 kB+1.04 MB+2.26 kB+41 B+1+109.67 ms

*) pp - percentage points - an absolute difference between two percentages.
Last updated: Wed, 01 Mar 2023 15:14:44 GMT

@mydea
mydea merged commit b887fb7 into developMar 1, 2023
@mydea
mydea deleted the fn/fix-metrics branch March 1, 2023 15:29
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@mydea@lforst