Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: update Electron to v30 #30334

Merged
merged 2 commits into from
Jun 20, 2024
Merged

test: update Electron to v30 #30334

merged 2 commits into from
Jun 20, 2024

Conversation

mxschmitt
Copy link
Member

@mxschmitt mxschmitt commented Apr 11, 2024

Electron v29 is the last supported version as of today. It only receives security updates, so it doesn't get our backport of electron/typescript-definitions#264.

Most of the fixme's which were removed were related to 'error: Browser context management is not supported.' which is fixed since electron/electron#41718.

Fixes #12096

Blocked by electron/typescript-definitions#264

This comment has been minimized.

@mxschmitt mxschmitt marked this pull request as draft April 11, 2024 14:39
@pavelfeldman

This comment was marked as outdated.

@mxschmitt mxschmitt reopened this May 31, 2024
@mxschmitt mxschmitt changed the title test: update Electron to v27 test: update Electron to v29 May 31, 2024
@mxschmitt mxschmitt added the CQ1 label May 31, 2024
@mxschmitt mxschmitt marked this pull request as ready for review May 31, 2024 09:32
@mxschmitt mxschmitt added CQ1 and removed CQ1 labels May 31, 2024

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

@mxschmitt mxschmitt marked this pull request as draft May 31, 2024 15:02
@mxschmitt mxschmitt changed the title test: update Electron to v29 test: update Electron to v30 Jun 20, 2024
@mxschmitt mxschmitt force-pushed the electron-30 branch 2 times, most recently from 335d8b3 to 24a81e0 Compare June 20, 2024 07:56
@mxschmitt mxschmitt added CQ1 and removed CQ1 labels Jun 20, 2024

This comment has been minimized.

This comment has been minimized.

@mxschmitt mxschmitt marked this pull request as ready for review June 20, 2024 08:51

This comment has been minimized.

test.skip(isAndroid);
test.skip(isElectron);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we keep these ones with the electron/browser version check instead? I find such historical annotations very useful later on.

@@ -88,8 +88,7 @@ it('should return headers', async ({ page, server, browserName }) => {
expect(response.request().headers()['user-agent']).toContain('WebKit');
});

it('should get the same headers as the server', async ({ page, server, browserName, platform, isElectron, browserMajorVersion }) => {
it.skip(isElectron && browserMajorVersion < 99, 'This needs Chromium >= 99');
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a strong reason to remove these annotations?

it.skip(isAndroid, 'No files on Android');
it.skip(browserName === 'firefox', 'Firefox does return null for file:https:// URLs');
it.skip(mode.startsWith('service'));

const fileurl = url.pathToFileURL(asset('frames/two-frames.html')).href;
const response = await page.goto(fileurl);
if (isElectron || (browserName === 'chromium' && browserMajorVersion >= 99) || (browserName === 'webkit' && isWindows))
if ((browserName === 'chromium' && browserMajorVersion >= 99) || (browserName === 'webkit' && isWindows))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This change is a bit surprising. I'd think that new electron behaves like new chromium and returns 200.

@mxschmitt mxschmitt added CQ1 and removed CQ1 labels Jun 20, 2024

This comment has been minimized.

Copy link
Contributor

Test results for "tests others"

5 failed
❌ [electron-page] › page/page-request-intercept.spec.ts:285:1 › request.postData is not null when fetching FormData with a Blob
❌ [electron-page] › page/page-request-intercept.spec.ts:285:1 › request.postData is not null when fetching FormData with a Blob
❌ [electron-page] › page/page-request-intercept.spec.ts:285:1 › request.postData is not null when fetching FormData with a Blob
❌ [playwright-test] › reporter-html.spec.ts:296:5 › created › should include image diff when screenshot failed to generate due to animation
❌ [playwright-test] › ui-mode-test-setup.spec.ts:217:9 › web-mode: true › should run teardown with SIGINT

17765 passed, 476 skipped
✔️✔️✔️

Merge workflow run.

@mxschmitt mxschmitt merged commit 7e1b69c into microsoft:main Jun 20, 2024
24 of 29 checks passed
Copy link
Contributor

Test results for "tests 1"

28374 passed, 648 skipped
✔️✔️✔️

Merge workflow run.

Copy link
Contributor

Test results for "tests 2"

6 fatal errors, not part of any test
3 failed
❌ [chromium-page] › page/page-set-input-files.spec.ts:40:3 › should upload a folder
❌ [chromium-page] › page/page-set-input-files.spec.ts:40:3 › should upload a folder
❌ [chromium-page] › page/page-set-input-files.spec.ts:40:3 › should upload a folder

50 flaky ⚠️ [chromium-library] › library/inspector/cli-codegen-1.spec.ts:23:7 › cli codegen › should click
⚠️ [chromium-library] › library/browsercontext-viewport.spec.ts:145:12 › should drag with high dpi
⚠️ [chromium-library] › library/capabilities.spec.ts:137:3 › should not crash on showDirectoryPicker
⚠️ [chromium-library] › library/inspector/cli-codegen-3.spec.ts:444:7 › cli codegen › should generate getByAltText
⚠️ [chromium-page] › page/page-add-locator-handler.spec.ts:90:5 › should work with locator.hover()
⚠️ [chromium-page] › page/page-mouse.spec.ts:221:3 › should tween mouse movement
⚠️ [chromium-library] › library/browsercontext-viewport.spec.ts:145:12 › should drag with high dpi
⚠️ [chromium-page] › page/page-add-locator-handler.spec.ts:90:5 › should work with locator.hover()
⚠️ [chromium-library] › library/popup.spec.ts:264:3 › should not throw when click closes popup
⚠️ [chromium-library] › library/selector-generator.spec.ts:223:5 › selector generator › should use parent text
⚠️ [chromium-library] › library/capabilities.spec.ts:137:3 › should not crash on showDirectoryPicker
⚠️ [chromium-library] › library/capabilities.spec.ts:68:3 › should play video @smoke
⚠️ [chromium-library] › library/chromium/chromium.spec.ts:38:5 › should emit new service worker on update
⚠️ [chromium-library] › library/downloads-path.spec.ts:32:5 › downloads path › should keep downloadsPath folder
⚠️ [chromium-library] › library/inspector/cli-codegen-1.spec.ts:23:7 › cli codegen › should click
⚠️ [chromium-library] › library/video.spec.ts:381:5 › screencast › should capture navigation
⚠️ [chromium-library] › library/inspector/cli-codegen-1.spec.ts:23:7 › cli codegen › should click
⚠️ [chromium-library] › library/inspector/cli-codegen-1.spec.ts:23:7 › cli codegen › should click
⚠️ [firefox-library] › library/inspector/cli-codegen-3.spec.ts:57:7 › cli codegen › should click locator.nth
⚠️ [firefox-library] › library/video.spec.ts:189:5 › screencast › should capture static page
⚠️ [firefox-page] › page/page-add-locator-handler.spec.ts:90:5 › should work with locator.hover()
⚠️ [firefox-page] › page/page-click-timeout-3.spec.ts:39:3 › should timeout waiting for hit target
⚠️ [firefox-page] › page/page-mouse.spec.ts:166:3 › should trigger hover state
⚠️ [firefox-library] › library/video.spec.ts:165:5 › screencast › should work with old options
⚠️ [firefox-library] › library/hit-target.spec.ts:398:3 › should click in iframe with padding
⚠️ [firefox-library] › library/selector-generator.spec.ts:180:5 › selector generator › should not use generated id
⚠️ [firefox-library] › library/trace-viewer.spec.ts:885:1 › should include requestUrl in route.abort
⚠️ [firefox-library] › library/tracing.spec.ts:292:5 › should overwrite existing file
⚠️ [firefox-page] › page/page-click.spec.ts:97:3 › should click the 1x1 div
⚠️ [firefox-page] › page/page-event-request.spec.ts:169:3 › should return response body when Cross-Origin-Opener-Policy is set
⚠️ [firefox-library] › library/tracing.spec.ts:412:14 › should produce screencast frames fit
⚠️ [chromium-page] › page/page-add-locator-handler.spec.ts:90:5 › should work with locator.hover()
⚠️ [chromium-library] › library/inspector/cli-codegen-1.spec.ts:23:7 › cli codegen › should click
⚠️ [chromium-library] › library/inspector/cli-codegen-2.spec.ts:24:7 › cli codegen › should contain open page
⚠️ [chromium-library] › library/trace-viewer.spec.ts:205:1 › should show null as a param
⚠️ [chromium-library] › library/trace-viewer.spec.ts:1250:1 › should show correct request start time
⚠️ [webkit-page] › page/page-set-input-files.spec.ts:40:3 › should upload a folder
⚠️ [webkit-page] › page/locator-misc-1.spec.ts:28:3 › should hover when Node is removed
⚠️ [webkit-library] › library/popup.spec.ts:115:3 › should inherit viewport size from browser context
⚠️ [webkit-page] › page/page-add-locator-handler.spec.ts:90:5 › should work with locator.hover()
⚠️ [webkit-library] › library/inspector/cli-codegen-1.spec.ts:791:7 › cli codegen › should click button with nested div
⚠️ [webkit-library] › library/browsercontext-viewport.spec.ts:145:12 › should drag with high dpi
⚠️ [webkit-library] › library/inspector/cli-codegen-1.spec.ts:627:7 › cli codegen › should await popup
⚠️ [webkit-library] › library/inspector/cli-codegen-3.spec.ts:562:7 › cli codegen › should assert value
⚠️ [webkit-library] › library/inspector/cli-codegen-3.spec.ts:634:7 › cli codegen › should assert visibility
⚠️ [webkit-page] › page/page-click.spec.ts:230:3 › should click on checkbox input and toggle
⚠️ [webkit-library] › library/tracing.spec.ts:412:14 › should produce screencast frames fit
⚠️ [webkit-library] › library/tracing.spec.ts:412:14 › should produce screencast frames crop
⚠️ [webkit-library] › library/browsercontext-reuse.spec.ts:50:1 › should reset serviceworker
⚠️ [webkit-page] › page/workers.spec.ts:243:3 › should support offline

206200 passed, 9154 skipped, 1382 did not run
✔️✔️✔️

Merge workflow run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FEATURE] Cookies not supported with Electron
3 participants