forked from consuldemocracy/consuldemocracy
-
Notifications
You must be signed in to change notification settings - Fork 16
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Flaky spec: Residence Assigned officers Error on verify Unable to find visible button "Validate document" #1211
Labels
Comments
I'll take this one |
Great @vicentemendozam 👏 lets hope not to see this one again :) Please remember to do that backport PR so we can close this issue (and the refactor you mentioned that would be awesome too!!) |
I hope so! 👍 |
Nice @vicentemendozam !! 👏 backport ✅ and issue completed :) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
What
Tests that fail randomly are called "flakies", this one seems to be one:
Randomized seed: 63774
Failure:
How
Tips for flaky hunting
Random values issues
If the problem comes from randomly generated values, running multiple times a single spec could help you reproduce the failure by running at your command line:
You can also try running a single spec in Travis:
Add option
:focus
to the spec and push your branch to Github, for example:But remember to remove that
:focus
changes afterwards when submitting your PR changes!Test order issues
Running specs in the order they failed may discover that the problem is that a previous test sets an state in the test environment that makes our flaky fail/pass. Tests should be independent from the rest.
After executing rspec you can see the seed used, add it as an option to rspec, for example:
bin/rspec --seed 55638
(check Randomized seed value at beginning of issue)Other things to watch for
The text was updated successfully, but these errors were encountered: