Skip to content

fix(test): unflake recorder aria snapshot highlight on Firefox/macOS - #42415

Closed
microsoft-playwright-automation[bot] wants to merge 1 commit into
mainfrom
fix-flakes/macos-15-large-32938196427
Closed

fix(test): unflake recorder aria snapshot highlight on Firefox/macOS#42415
microsoft-playwright-automation[bot] wants to merge 1 commit into
mainfrom
fix-flakes/macos-15-large-32938196427

Conversation

@microsoft-playwright-automation

Copy link
Copy Markdown
Contributor

'should update aria snapshot highlight' flakes on firefox-macos-15-large:
6/308 runs failed (~2%), all recent (latest 2026-08-25), only on that bot.
Typing "Cancel" into the recorder's aria editor fires a rapid burst of
highlightRequested updates; the intermediate templates match zero elements
and clear the highlight, and only the final '- button "Cancel"' matches.
Under load these one-shot requests race so a clearing request can land after
the matching one, leaving x-pw-highlight absent with no further editor change
to re-push it, so toBeVisible() polls in vain. A diagnostic confirmed the
editor content is correct ('- button "Cancel"') at failure time.

Scope a test.fixme to firefox && isMac while the recorder highlight race is
addressed; the test still runs everywhere else.

Verified on firefox-macos-15-large: reproduced 12 failed + 22 flaky / 120 with
--repeat-each=80..120 --workers=10 before the change; after, skipped on
firefox and still passes on chromium (ctest). npm run flint passes.

DB evidence (macos-15-large window): 6 failed / 308 runs, only firefox.
Run history (firefox-macos-15-large, oldest first):
🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟧🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟧🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟧🟩🟧🟩🟩🟧🟧🟩🟩🟩🟩🟧🟧🟧🟩🟥🟥🟧🟧🟩🟧🟩🟩🟩🟧🟩🟩🟩🟧🟧🟧🟩🟥🟥🟧🟧🟧🟧🟥🟥🟧🟧🟩🟧

CI run: https://github.com/microsoft/playwright/actions/runs/32938196427

Suggested-reviewer: pavelfeldman
Co-authored-by: Copilot 223556219+Copilot@users.noreply.github.com

'should update aria snapshot highlight' flakes on firefox-macos-15-large:
6/308 runs failed (~2%), all recent (latest 2026-08-25), only on that bot.
Typing "Cancel" into the recorder's aria editor fires a rapid burst of
highlightRequested updates; the intermediate templates match zero elements
and clear the highlight, and only the final '- button "Cancel"' matches.
Under load these one-shot requests race so a clearing request can land after
the matching one, leaving x-pw-highlight absent with no further editor change
to re-push it, so toBeVisible() polls in vain. A diagnostic confirmed the
editor content is correct ('- button "Cancel"') at failure time.
Scope a test.fixme to firefox && isMac while the recorder highlight race is
addressed; the test still runs everywhere else.
Verified on firefox-macos-15-large: reproduced 12 failed + 22 flaky / 120 with
--repeat-each=80..120 --workers=10 before the change; after, skipped on
firefox and still passes on chromium (ctest). npm run flint passes.
DB evidence (macos-15-large window): 6 failed / 308 runs, only firefox.
Run history (firefox-macos-15-large, oldest first):
[🟩](https://github.com/microsoft/playwright/actions/runs/29461343212/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29493630712/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29493689996/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29494668376/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29496276570/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29497431241/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29501896183/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29504809298/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29505924688/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29506925842/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29507208821/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29507279787/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29510845830/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29513769523/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29516108305/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29525081398/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29527833904/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29528556146/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29531605213/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29531635659/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29536656250/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29544830063/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29585973013/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29587651108/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29589683538/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29589934673/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29595934280/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29598530258/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29602613490/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29611131294/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29611318218/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29611445029/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29612805092/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29613759502/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29618375255/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29686210360/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29730373358/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29734693205/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29755368802/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29762776585/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29763385504/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29769696091/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29775716877/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29780743634/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29782328403/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29784817456/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29789509369/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29791328941/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29791345408/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29800511868/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29822273353/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29835236639/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29838699822/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29844141129/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29845392058/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29855614229/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29855625844/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29856729151/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29859883032/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29865460136/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29866867131/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29867308985/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29873996100/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29874748609/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29874783963/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29877078341/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29879172510/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29904950059/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29915407358/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29918102409/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29924682554/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29931173316/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29932910968/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29933325202/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29938598979/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29940740538/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29945241493/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29957712363/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29960743816/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29986800439/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/30000526442/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30002550609/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30003704436/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30012947805/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30013000317/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30013096187/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30016032633/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30019936660/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30020951577/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30028622968/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30030075729/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30034117131/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30037717793/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30043643329/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30046492986/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30046789125/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30047266180/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30054321343/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30055514373/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30056208622/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30059081941/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30061239008/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30064063966/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30087004304/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30087062553/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30087527278/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30088593278/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30096158712/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30096561860/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30099474083/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30106394430/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30109152699/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30125949342/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30125931463/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30128284458/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30128358440/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30128549016/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30128995674/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30130964830/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30281800940/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30282186242/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30282257105/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30295966994/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30314129578/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30317038982/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30317255895/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30345832284/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30357733547/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30362312636/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30374618561/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30374665387/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30374719582/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30374877599/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30375058435/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30375461275/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30439562399/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30441064351/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30441096149/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30467361553/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30467478444/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30469106593/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30469413084/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30481073486/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30490358021/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30490403874/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30493031010/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30493959683/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30495285330/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30498894356/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30530696555/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30534756293/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30539645601/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30542293233/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30542345092/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30559579795/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30565052100/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30568188818/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30568293053/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30568320872/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30577572373/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30581383958/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30581357288/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30581405526/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30585190825/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30618799783/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30624512498/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30653773411/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30667286182/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30667347031/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30833251658/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30850656923/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30850749658/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30854798001/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30859315578/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30859305376/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30859360344/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30885108613/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30885140825/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30885208556/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30885237385/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30885274230/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30917613834/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30927071352/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30927719515/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30930057055/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30933859878/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30934926278/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30940141663/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30945227770/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30954253724/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30954381228/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30955628029/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30983589511/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30994484036/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30999293932/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31005632732/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31028827279/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31041443233/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31049625776/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31054103593/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31098380388/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31122189433/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31123807173/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31123883015/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31157128027/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31180563968/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31204862769/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31206290641/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31220926990/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31222969489/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31225630257/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31334893949/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31374103418/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31376107795/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31427587624/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31427825311/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31432687936/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31470470067/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31473830631/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31482465720/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31514273367/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31522523272/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31522956139/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/31523555811/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31528607265/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31528655674/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31536261957/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31539450349/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31541583831/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31541643674/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31543458204/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31543488476/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31559512519/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31594920659/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31600808179/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31625352036/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31628432697/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31643262553/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31643694940/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31664294556/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31721615575/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31727687932/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31730238237/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31731785992/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31731796877/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31731845797/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31731827862/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31731805310/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31736069810/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31737022508/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31737081745/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31748386106/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31805318610/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31813272567/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31813336285/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31815098566/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31828796301/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31852438041/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31853242630/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32022627609/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32031888120/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32045044240/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32072087605/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32072899533/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32080724736/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32096692467/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32155212774/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32167927481/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32191005270/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32191018074/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32200595397/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32209438088/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32276523262/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32294455960/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32294592709/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32294682037/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32295864895/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32311853762/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32314701339/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/32321251477/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/32371792444/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32395156139/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32401098591/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32406519027/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32409435636/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32410065699/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32413005321/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32413144531/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32422829924/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32426569439/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32426604716/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32433041248/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32471319393/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32485005778/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32510988871/attempts/2)[🟩](https://github.com/microsoft/playwright/actions/runs/32517091267/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/32535562938/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/32535606951/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32550476635/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32755877707/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32776993262/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32778569671/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/32790033001/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/32881822696/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32883301578/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32883717476/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32914278611/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32916417298/attempts/1)
CI run: https://github.com/microsoft/playwright/actions/runs/32938196427
Suggested-reviewer: pavelfeldman
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor

Test results for "tests 1"

4 flaky⚠️ [chromium-library] › library/browsercontext-page-event.spec.ts:173 › should work with Ctrl-clicking `@chromium-ubuntu-22.04-arm-node20`
⚠️ [chromium-library] › library/video.spec.ts:736 › screencast › should work with video+trace `@realtime-time-library-chromium-linux`
⚠️ [firefox-page] › page/page-event-request.spec.ts:181 › should return response body when Cross-Origin-Opener-Policy is set `@firefox-ubuntu-22.04-node20`
⚠️ [firefox-page] › page/page-goto.spec.ts:90 › should work with Cross-Origin-Opener-Policy `@firefox-ubuntu-22.04-node20`

51261 passed, 1237 skipped


Merge workflow run.

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "MCP"

1 failed
❌ [firefox] › mcp/annotate.spec.ts:446 › should switch screencast to -s session on show --annotate @mcp-windows-latest-firefox

8258 passed, 1361 skipped


Merge workflow run.

@github-actions

Copy link
Copy Markdown
Contributor

🟢 CI is clear — the one failure is a known, unrelated flake

Hi, I'm the Playwright bot and I took a first look at the CI results here.

Nothing points at this PR. The only hard failure — [firefox] › mcp/annotate.spec.ts:446 › should switch screencast to -s session on show --annotate on mcp-windows-latest-firefox — is a long-standing flake that fails on plenty of SHAs this PR can't be responsible for. This change only adds a test.fixme gate to cli-codegen-aria.spec.ts, which doesn't touch the MCP annotate/screencast path. The other four results were flaky (passed on retry), so there's nothing to triage there.

Details

Overall: the diff is a one-line test.fixme(browserName === 'firefox' && isMac) on tests/library/inspector/cli-codegen-aria.spec.ts. It can only ever skip one recorder test on Firefox/macOS — it can't add failures elsewhere.

Pre-existing flake / infra

Flaky (rescued on retry — not failures)

  • [chromium-library] › library/browsercontext-page-event.spec.ts:173 › should work with Ctrl-clicking
  • [chromium-library] › library/video.spec.ts:736 › screencast › should work with video+trace
  • [firefox-page] › page/page-event-request.spec.ts:181 › should return response body when Cross-Origin-Opener-Policy is set
  • [firefox-page] › page/page-goto.spec.ts:90 › should work with Cross-Origin-Opener-Policy

All four passed on retry and are unrelated to a recorder-test fixme.

Triaged by the Playwright bot - agent run

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@pavelfeldman