-
Notifications
You must be signed in to change notification settings - Fork 915
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Increase e2e test reliability #5671
Comments
I've seen |
https://app.buildpulse.io/@crossplane/crossplane - For the record, this is now tracking our E2E flakes. |
Hello, @negz, I was wishing to contribute in increasing test reliability. But the link doesnt work anymore. Gives me a 404. |
This is probably an access issue - I'm trying to find a way to make the test results viewable for anyone, but I don't see that setting just yet 😂 |
What problem are you facing?
The e2e tests for Crossplane have not been as reliable as we'd like lately. For example, bumping the crossplane-runtime dependency in preparation for the v1.16 release was delayed due to e2e test failures that had been present in master for awhile (#5652 (comment)).
Ideally, we would be getting consistent green builds where all tests pass, but recently we've been getting more failures that are more likely to be test issues as opposed to genuine issues in the code we ship.
The less reliable our tests are, the less confidence we have in what we're shipping.
How could Crossplane help solve your problem?
This is a high level epic for improving our confidence and reliability in the e2e tests.
Framework improvements
Flaky tests
The text was updated successfully, but these errors were encountered: