Skip to content

test: Fix flaky errorsInSession replay test - #7309

Merged
mydea merged 1 commit into
developfrom
fn/fix-flaky-error-session-test
Mar 1, 2023
Merged

test: Fix flaky errorsInSession replay test#7309
mydea merged 1 commit into
developfrom
fn/fix-flaky-error-session-test

Conversation

@mydea

@mydeamydea commented Mar 1, 2023

Copy link
Copy Markdown
Member

Hopefully fix#7269

@mydea
mydea requested a review from Lms24March 1, 2023 11:44
@mydeamydea self-assigned this Mar 1, 2023
@mydea
mydeaforce-pushed the fn/fix-flaky-error-session-test branch from 5168f1a to 8b122b7CompareMarch 1, 2023 12:00
@github-actions

github-actionsBot commented Mar 1, 2023

Copy link
Copy Markdown
Contributor

Replay SDK metrics 🚀

Plain+Sentry+Replay
RevisionValueValueDiffRatioValueDiffRatio
LCPThis PR 73a1bbb71.93 ms61.93 ms-10.00 ms-13.90 %62.05 ms-9.88 ms-13.74 %
Previous 3ba8e0b61.25 ms73.45 ms+12.20 ms+19.92 %72.64 ms+11.39 ms+18.60 %
CLSThis PR 73a1bbb0.00 ms0.00 ms0.00 ms0.00 %0.24 ms+0.23 ms+5061.68 %
Previous 3ba8e0b0.00 ms0.00 ms0.00 ms0.00 %0.26 ms+0.26 ms+5553.44 %
CPUThis PR 73a1bbb18.62 %21.13 %+2.51 pp+13.49 %37.63 %+19.01 pp+102.14 %
Previous 3ba8e0b17.48 %19.51 %+2.03 pp+11.61 %36.08 %+18.59 pp+106.36 %
JS heap avgThis PR 73a1bbb3.52 MB6.81 MB+3.28 MB+93.15 %11.05 MB+7.53 MB+213.52 %
Previous 3ba8e0b3.54 MB6.91 MB+3.37 MB+95.28 %11.18 MB+7.64 MB+216.09 %
JS heap maxThis PR 73a1bbb3.88 MB8.3 MB+4.42 MB+114.08 %14 MB+10.12 MB+261.11 %
Previous 3ba8e0b3.89 MB8.29 MB+4.4 MB+113.13 %14.31 MB+10.42 MB+267.77 %
netTxThis PR 73a1bbb0 B348.76 kB+348.76 kBn/a106.05 kB+106.05 kBn/a
Previous 3ba8e0b0 B360.35 kB+360.35 kBn/a105.73 kB+105.73 kBn/a
netRxThis PR 73a1bbb17.62 kB19.04 kB+1.41 kB+8.02 %17.26 kB-365 B-2.07 %
Previous 3ba8e0b18.13 kB18.35 kB+222 B+1.22 %18.46 kB+332 B+1.83 %
netCountThis PR 73a1bbb12+1+100.00 %4.6+3.5999999999999996+360.00 %
Previous 3ba8e0b12+1+100.00 %4+3+300.00 %
netTimeThis PR 73a1bbb420.73 ms450.51 ms+29.78 ms+7.08 %628.26 ms+207.54 ms+49.33 %
Previous 3ba8e0b601.86 ms692.68 ms+90.82 ms+15.09 %669.72 ms+67.85 ms+11.27 %

Previous results on branch: develop

RevisionLCPCLSCPUJS heap avgJS heap maxnetTxnetRxnetCountnetTime
3ba8e0b+11.39 ms+0.26 ms+18.59 pp+7.64 MB+10.42 MB+105.73 kB+332 B+3+67.85 ms
dbd7a81+98.37 ms-0.00 ms+6.68 pp+1.64 MB+1.82 MB+2.23 kB+41 B+1+124.71 ms
dbd7a81+86.19 ms-0.00 ms+6.77 pp+1.58 MB+1.67 MB+2.23 kB+41 B+1+87.99 ms
67b0684+84.74 ms-0.00 ms+7.38 pp+1.7 MB+1.81 MB+2.23 kB+41 B+1+85.52 ms
4b95c04+57.56 ms-0.00 ms+7.94 pp+920.88 kB+1.05 MB+2.21 kB+41 B+1+90.32 ms
e60cd02+56.25 ms-0.00 ms+6.32 pp+927.44 kB+1.06 MB+2.21 kB+41 B+1+117.55 ms
e25c067+48.34 ms+0.00 ms+5.59 pp+926.37 kB+1.05 MB+2.22 kB+41 B+1+65.23 ms
b1b249b+43.88 ms+0.00 ms+4.80 pp+937.99 kB+1.05 MB+2.22 kB+41 B+1+111.56 ms
12e34d4+28.57 ms+0.00 ms+5.77 pp+930.12 kB+1.04 MB+2.26 kB+41 B+1+109.67 ms
c46c56c+65.45 ms-0.00 ms+5.38 pp+930.26 kB+1.07 MB+2.21 kB+41 B+1+91.29 ms

*) pp - percentage points - an absolute difference between two percentages.
Last updated: Wed, 01 Mar 2023 12:04:13 GMT

@mydea
mydeaforce-pushed the fn/fix-flaky-error-session-test branch 3 times, most recently from 8f90a29 to 678c5d7CompareMarch 1, 2023 13:54
@mydea
mydeaforce-pushed the fn/fix-flaky-error-session-test branch from f3ec6e3 to d691af7CompareMarch 1, 2023 14:29
@mydea
mydea marked this pull request as ready for review March 1, 2023 14:30
const url = await getLocalTestPath({ testDir: __dirname });

await page.goto(url);
await page.click('#go-background');

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This could probably sometimes lead to a second flush, which we didn't actually want/need. It will flush on page visit anyhow!

*/
export function waitForReplayRequest(page: Page, segmentId?: number): Promise<Request> {
return page.waitForRequest(req => {
export function waitForReplayRequest(page: Page, segmentId?: number): Promise<Response> {

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We actually wait on a response here now, as that may be a bit better/more expected timing.

@mydea
mydea requested a review from lforstMarch 1, 2023 14:31

@Lms24Lms24 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for taking care of this!

@mydea
mydea merged commit 8a5e0c3 into developMar 1, 2023
@mydea
mydea deleted the fn/fix-flaky-error-session-test branch March 1, 2023 14:44
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Flaky CI]: Playwright Replay errors in session mode test

2 participants

@mydea@Lms24