Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Flaky GUI tests #7498

Closed
drew2a opened this issue Jun 21, 2023 · 1 comment
Closed

Flaky GUI tests #7498

drew2a opened this issue Jun 21, 2023 · 1 comment

Comments

@drew2a
Copy link
Collaborator

drew2a commented Jun 21, 2023

I'm trying to find flaky tests in the Tribler test suite by using this tool: https://github.com/dropbox/pytest-flakefinder

Here is the description of the experiment: Each test was run 50 times (no parallel), using macOS as the operating system and Python version 3.9.6.

no UI

pytest src/tribler/gui --flake-finder

======================================================== short test summary info ========================================================
FAILED src/tribler/gui/tests/test_core_manager.py::test_on_core_read_ready_os_error_suppressed[41] - assert 4 == 2
===================================== 49 failed, 2901 passed, 950 skipped, 7802 warnings in 33.59s ======================================

UI

pytest src/tribler/gui --flake-finder

======================================================== short test summary info ========================================================
FAILED src/tribler/gui/tests/test_gui.py::test_add_download_url[6] - tribler.gui.tests.test_gui.TimeoutException: Variable downloads_page.downloads within 10 seconds
FAILED src/tribler/gui/tests/test_gui.py::test_discovered_page[42] - tribler.gui.tests.test_gui.TimeoutException: The list was not populated within 10 seconds
FAILED src/tribler/gui/tests/test_gui.py::test_add_deeptorrent[31] - AssertionError: assert not {'AttributeError'}
FAILED src/tribler/gui/tests/test_gui.py::test_tags_dialog[43] - assert []
====================================== 144 failed, 806 passed, 1903 warnings in 3192.56s (0:53:12) ======================================

This issue is related to #7132 and #7134

@drew2a
Copy link
Collaborator Author

drew2a commented Nov 21, 2023

I'm closing this issue as it appears that everything fixable has already been addressed. For any new detections of frozen tests, please refer to the registry at #7706. For new flaky tests, feel free to open a separate issue.

@drew2a drew2a closed this as completed Nov 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant