Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: fix flaky integration::bench::multifile_summary test #14771

Merged
merged 5 commits into from
Jun 2, 2022
Merged

chore: fix flaky integration::bench::multifile_summary test #14771

merged 5 commits into from
Jun 2, 2022

Conversation

GJZwiers
Copy link
Contributor

@GJZwiers GJZwiers commented Jun 1, 2022

Fixes #14732. The test is flaky because sometimes "parse url 6x" runs faster than "parse url 2x". I think it may be because the execution time difference between the two benches is quite small and if a CI runner has a small performance dip, it results in the parse url 2x being slower than the parse url 6x on occasion.

This PR changes the 6x to 200x creating a bigger difference. An alternative could also be to change the slower/faster to wildcards instead.

Copy link
Member

@bartlomieju bartlomieju left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks!

@bartlomieju bartlomieju merged commit 7d9e8ba into denoland:main Jun 2, 2022
@GJZwiers GJZwiers deleted the fix_flaky_bench_test branch June 2, 2022 07:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

integration::bench::multifile_summary is flaky
2 participants