Skip to content

test(recorder): skip flaky aria snapshot highlight test on Firefox - #42391

Closed
microsoft-playwright-automation[bot] wants to merge 1 commit into
mainfrom
fix-flakes/macos-15-large-32817036325
Closed

test(recorder): skip flaky aria snapshot highlight test on Firefox#42391
microsoft-playwright-automation[bot] wants to merge 1 commit into
mainfrom
fix-flakes/macos-15-large-32817036325

Conversation

@microsoft-playwright-automation

Copy link
Copy Markdown
Contributor

The recorder highlight intermittently fails to update after editing the aria
snapshot text on Firefox only, so x-pw-highlight is either missing or still
resolves to two elements when the assertion runs. Skip it on Firefox until the
highlight update is made reliable there.

DB evidence (rolling CI window):

  • firefox-library: 5 failed runs / 1899, still failing 2026-08-24.
  • chromium-library: 0 / 7512. webkit-library: 0 / 1886. Firefox-only.
  • On firefox-macos-15-large: 5 red + 20 retry-rescued out of 311 runs.
  • Failures: expect(locator('x-pw-highlight')).toBeVisible() element not
    found (41 rows) and strict-mode violation resolving to 2 elements (15 rows).

Run history (firefox-library, firefox-macos-15-large), oldest first:
🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟧🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟧🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟩🟧🟩🟧🟩🟩🟧🟧🟩🟩🟩🟩🟧🟧🟧🟩🟥🟥🟧🟧🟩🟧🟩🟩🟩🟧🟩🟩🟩🟧🟧🟧🟩🟥🟥🟧🟧🟧🟧🟥

Verified locally on macos-15-large:

  • Reproduced on Firefox: 23/60 flaky at --repeat-each=60 --workers=8.
  • After skip: Firefox reports the test skipped; Chromium still runs and passes.
  • npm run flint passes.

https://github.com/microsoft/playwright/actions/runs/32817036325

Suggested-reviewer: pavelfeldman

Co-authored-by: Copilot 223556219+Copilot@users.noreply.github.com

The recorder highlight intermittently fails to update after editing the aria
snapshot text on Firefox only, so x-pw-highlight is either missing or still
resolves to two elements when the assertion runs. Skip it on Firefox until the
highlight update is made reliable there.
DB evidence (rolling CI window):
- firefox-library: 5 failed runs / 1899, still failing 2026-08-24.
- chromium-library: 0 / 7512. webkit-library: 0 / 1886. Firefox-only.
- On firefox-macos-15-large: 5 red + 20 retry-rescued out of 311 runs.
- Failures: expect(locator('x-pw-highlight')).toBeVisible() element not
found (41 rows) and strict-mode violation resolving to 2 elements (15 rows).
Run history (firefox-library, firefox-macos-15-large), oldest first:
[🟩](https://github.com/microsoft/playwright/actions/runs/29416849206/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29417339107/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29420362810/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29421177744/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29426009862/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29434021274/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29449506755/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29457511205/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29461343212/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29493630712/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29493689996/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29494668376/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29496276570/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29497431241/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29501896183/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29504809298/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29505924688/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29506925842/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29507208821/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29507279787/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29510845830/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29513769523/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29516108305/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29525081398/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29527833904/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29528556146/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29531605213/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29531635659/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29536656250/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29544830063/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29585973013/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29587651108/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29589683538/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29589934673/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29595934280/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29598530258/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29602613490/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29611131294/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29611318218/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29611445029/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29612805092/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29613759502/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29618375255/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29686210360/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29730373358/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29734693205/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29755368802/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29762776585/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29763385504/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29769696091/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29775716877/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29780743634/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29782328403/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29784817456/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29789509369/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29791328941/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29791345408/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29800511868/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29822273353/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29835236639/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29838699822/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29844141129/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29845392058/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29855614229/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29855625844/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29856729151/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29859883032/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29865460136/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29866867131/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29867308985/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29873996100/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29874748609/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29874783963/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29877078341/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29879172510/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29904950059/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29915407358/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29918102409/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29924682554/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29931173316/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29932910968/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29933325202/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29938598979/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29940740538/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29945241493/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29957712363/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29960743816/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29986800439/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/30000526442/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30002550609/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30003704436/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30012947805/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30013000317/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30013096187/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30016032633/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30019936660/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30020951577/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30028622968/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30030075729/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30034117131/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30037717793/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30043643329/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30046492986/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30046789125/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30047266180/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30054321343/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30055514373/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30056208622/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30059081941/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30061239008/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30064063966/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30087004304/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30087062553/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30087527278/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30088593278/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30096158712/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30096561860/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30099474083/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30106394430/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30109152699/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30125949342/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30125931463/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30128284458/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30128358440/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30128549016/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30128995674/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30130964830/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30281800940/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30282186242/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30282257105/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30295966994/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30314129578/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30317038982/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30317255895/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30345832284/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30357733547/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30362312636/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30374618561/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30374665387/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30374719582/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30374877599/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30375058435/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30375461275/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30439562399/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30441064351/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30441096149/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30467361553/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30467478444/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30469106593/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30469413084/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30481073486/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30490358021/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30490403874/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30493031010/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30493959683/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30495285330/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30498894356/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30530696555/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30534756293/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30539645601/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30542293233/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30542345092/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30559579795/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30565052100/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30568188818/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30568293053/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30568320872/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30577572373/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30581383958/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30581357288/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30581405526/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30585190825/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30618799783/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30624512498/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30653773411/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30667286182/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30667347031/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30833251658/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30850656923/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30850749658/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30854798001/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30859315578/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30859305376/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30859360344/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30885108613/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30885140825/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30885208556/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30885237385/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30885274230/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30917613834/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30927071352/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30927719515/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30930057055/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30933859878/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30934926278/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30940141663/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30945227770/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30954253724/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30954381228/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30955628029/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30983589511/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30994484036/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30999293932/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31005632732/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31028827279/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31041443233/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31049625776/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31054103593/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31098380388/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31122189433/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31123807173/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31123883015/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31157128027/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31180563968/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31204862769/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31206290641/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31220926990/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31222969489/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31225630257/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31334893949/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31374103418/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31376107795/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31427587624/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31427825311/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31432687936/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31470470067/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31473830631/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31482465720/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31514273367/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31522523272/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31522956139/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/31523555811/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31528607265/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31528655674/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31536261957/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31539450349/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31541583831/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31541643674/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31543458204/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31543488476/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31559512519/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31594920659/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31600808179/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31625352036/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31628432697/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31643262553/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31643694940/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31664294556/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31721615575/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31727687932/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31730238237/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31731785992/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31731796877/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31731845797/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31731827862/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31731805310/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31736069810/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31737022508/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31737081745/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31748386106/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31805318610/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31813272567/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31813336285/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31815098566/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31828796301/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31852438041/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/31853242630/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32022627609/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32031888120/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32045044240/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32072087605/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32072899533/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32080724736/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32096692467/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32155212774/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32167927481/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32191005270/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32191018074/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32200595397/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32209438088/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32276523262/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32294455960/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32294592709/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32294682037/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32295864895/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32311853762/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32314701339/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/32321251477/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/32371792444/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32395156139/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32401098591/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32406519027/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32409435636/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32410065699/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32413005321/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32413144531/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32422829924/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32426569439/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32426604716/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/32433041248/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32471319393/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32485005778/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32510988871/attempts/2)[🟩](https://github.com/microsoft/playwright/actions/runs/32517091267/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/32535562938/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/32535606951/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32550476635/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32755877707/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32776993262/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/32778569671/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/32790033001/attempts/1)
Verified locally on macos-15-large:
- Reproduced on Firefox: 23/60 flaky at --repeat-each=60 --workers=8.
- After skip: Firefox reports the test skipped; Chromium still runs and passes.
- npm run flint passes.
https://github.com/microsoft/playwright/actions/runs/32817036325
Suggested-reviewer: pavelfeldman
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor

Test results for "MCP"

1 failed
❌ [firefox] › mcp/annotate.spec.ts:446 › should switch screencast to -s session on show --annotate @mcp-windows-latest-firefox

8258 passed, 1361 skipped


Merge workflow run.

@github-actions

Copy link
Copy Markdown
Contributor

Hi, I'm the Playwright bot and I took a first look at the failing CI.

🟢 The one failure is an unrelated pre-existing flake — this PR is clear

[firefox] › mcp/annotate.spec.ts:446 › should switch screencast to -s session on show --annotate flakes on its own: failed 23 of 712 firefox runs (~3%), passed the other 689, on SHAs and PRs unrelated to this one (e.g. #41966). This PR only adds a test.fixme gate to a recorder test in cli-codegen-aria.spec.ts and touches no MCP or screencast code.

Details

The change here is a one-line, Firefox-only test.fixme on should update aria snapshot highlight in tests/library/inspector/cli-codegen-aria.spec.ts. It doesn't touch product code or any MCP path.

Pre-existing flake / infra

  • [firefox] › mcp/annotate.spec.ts:446 › should switch screencast to -s session on show --annotate (@mcp-windows-latest-firefox) — pre-existing flake, not caused by this PR. In the CI results DB this test flips verdict on firefox: 23 failed / 689 passed across 712 runs, failing on unrelated PRs/SHAs (e.g. fix(mcp): reconnect to the browser after disconnect #41966), and only marginally on the other engines (chromium 3/724, chrome 2/728, webkit 1/729). The diff here doesn't exercise the MCP screencast/annotate flow at all.

No failure in this report is attributable to the PR.

Triaged by the Playwright bot - agent run

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "tests 1"

1 failed
❌ [playwright-test] › playwright.trace.spec.ts:1355 › should not nest top level expect into unfinished api calls @ubuntu-latest-node26

4 flaky⚠️ [chromium-library] › library/video.spec.ts:664 › screencast › should capture full viewport `@chromium-ubuntu-22.04-arm-node20`
⚠️ [chromium-library] › library/video.spec.ts:495 › screencast › should capture static page in persistent context Radoslav Kirilov (@smoke) `@chromium-ubuntu-22.04-node24`
⚠️ [firefox-page] › page/page-emulate-media.spec.ts:144 › should keep reduced motion and color emulation after reload `@firefox-ubuntu-22.04-node20`
⚠️ [firefox-page] › page/page-goto.spec.ts:90 › should work with Cross-Origin-Opener-Policy `@firefox-ubuntu-22.04-node20`

51400 passed, 1239 skipped


Merge workflow run.

@github-actions

Copy link
Copy Markdown
Contributor

Hi, I'm the Playwright bot and I took a first look at the failing CI.

🟢 Both failures are pre-existing flakes — this PR is clear

The diff here is a single-line, Firefox-only test.fixme on should update aria snapshot highlight in tests/library/inspector/cli-codegen-aria.spec.ts. It touches no product code and no MCP or trace path, and neither failing test is one it can reach.

Details

Pre-existing flake / infra

The 4 flaky results in the "tests 1" report passed on retry and need no triage. No failure in either report is attributable to this PR.

Triaged by the Playwright bot - agent run

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@pavelfeldman