Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inconsistent result in unit test for "aps_randomized_cv_crossval" in classification #377

Open
thibaultcordier opened this issue Nov 14, 2023 · 1 comment
Labels
bug Something isn't working developers Proposed by developers. good first issue Good for newcomers

Comments

@thibaultcordier
Copy link
Collaborator

Describe the bug
When the unit tests are run, one test gives inconsistent results (for the "aps_randomized_cv_crossval" method in the classification).

To Reproduce
Steps to reproduce the behavior:

  1. Run the test_toy_dataset_predictions test several times in mapie/tests/test_classification.py.

Expected behavior
Consistent results when tests are run several times.

@thibaultcordier thibaultcordier added the bug Something isn't working label Nov 14, 2023
thibaultcordier added a commit that referenced this issue Nov 14, 2023
CI/CD: change version of numpy and python for CI/CD
TMP: relaxing certain constraints #377 #378
@LacombeLouis LacombeLouis added the good first issue Good for newcomers label Nov 17, 2023
@thibaultcordier thibaultcordier added the developers Proposed by developers. label Dec 11, 2023
@BaptisteCalot
Copy link
Collaborator

Hello everyone ! I tried to reproduce the bug without success. How am I supposed to get a bad result? We agree that the inconsistent result is supposed to make the test fail, right ? @thibaultcordier

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working developers Proposed by developers. good first issue Good for newcomers
Projects
Status: Bugs to be fixed (High Priority)
Development

No branches or pull requests

3 participants