Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(create-svelte): address flakiness in playwright test #8162

Merged
merged 2 commits into from
Dec 19, 2022

Conversation

mxschmitt
Copy link
Contributor

Congrats to the version release! Before no web-first assertion was used for the assertion, which means that it did not retry and just failed when the text was not matching. Now its using toHaveText which is recommended and not flaky.

There were more such places inside the sveltekit codebase, seems not related, since its not customer facing, but might still be worth updating.

Please don't delete this checklist! Before submitting the PR, please make sure you do the following:

  • It's really useful if your PR references an issue where it is discussed ahead of time. In many cases, features are absent for a reason. For large changes, please create an RFC: https://github.com/sveltejs/rfcs
  • This message body should clearly illustrate what problems it solves.
  • Ideally, include a test that fails without this PR but passes with it.

Tests

  • Run the tests with pnpm test and lint the project with pnpm lint and pnpm check

Changesets

  • If your PR makes a change that should be noted in one or more packages' changelogs, generate a changeset by running pnpm changeset and following the prompts. All changesets should be patch until SvelteKit 1.0

@vercel
Copy link

vercel bot commented Dec 14, 2022

@mxschmitt is attempting to deploy a commit to the Svelte Team on Vercel.

A member of the Team first needs to authorize it.

@changeset-bot
Copy link

changeset-bot bot commented Dec 14, 2022

🦋 Changeset detected

Latest commit: 9687589

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 1 package
Name Type
create-svelte Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@benmccann
Copy link
Member

There were more such places inside the sveltekit codebase, seems not related, since its not customer facing, but might still be worth updating.

Yes, please! PRs welcome to reduce flakiness

@benmccann benmccann changed the title chore(create-svelte): use web-first assertion for assertion in PW chore(create-svelte): address flakiness in playwright test Dec 16, 2022
@dominikg
Copy link
Member

general note on await expect:

i think in this instance it's ok to use it, but in general this is not what we want. esp within framework tests we want to expect acutal state at a specific point, not eventual state after a specific point.
this is both faster and more correct

@benmccann benmccann merged commit 0f60aef into sveltejs:master Dec 19, 2022
@github-actions github-actions bot mentioned this pull request Dec 19, 2022
robBowes pushed a commit to robBowes/kit that referenced this pull request Dec 20, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants