Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: make elixir should match what we run in CI #4691

Merged
merged 1 commit into from
Jul 28, 2023
Merged

Conversation

janl
Copy link
Member

@janl janl commented Jul 22, 2023

test(make): remove elixir target, rename elixir-suite to elixir

The elixir target should run the default set that passes all tests.
The old target ran search tests that would fail without a separate
clouseau setup step. The new elixir target is what we actually run
in CI. This should prevent developer confusion when things pass in CI
but fail locally or vice versa.

Before:

Because in make elixir dev/run is started without --with-nouveau,
but the newish --exclude nouveau option is conditional on whether
./configure was run with --enable-nouveau — what we really want is
to --exclude nouveau in make elixir unconditionally, because those
tests are run separately in make nouveau-test which does start dev/run
with nouveau correctly.

Also:
test: do not run clouseau tests by default

This introduces a new --enable-clouseau-tests option for ./configure
that selectively enables make elixir-search during make check.

Updates to our respective Jenkinsfiles to accommodate this.

This should have no functional difference in CI but make make elixir work on systems that do not have Clousau running.

@janl janl changed the title fix: make elixir should not run nouveau tests at all fix: make elixir should pass without clousau or nouveau Jul 22, 2023
@janl janl requested review from nickva and big-r81 July 22, 2023 10:04
Copy link
Contributor

@big-r81 big-r81 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

nickva
nickva previously requested changes Jul 24, 2023
Copy link
Contributor

@nickva nickva left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure if enabling clouseau would work with the current CI setup? I do not recall us setting up any dev/run or CI image clouseau bits, I think we'd need some of those things before we can enable these tests by default.

build-aux/Jenkinsfile.full Outdated Show resolved Hide resolved
configure Outdated Show resolved Hide resolved
@janl
Copy link
Member Author

janl commented Jul 24, 2023

my assumption was that clouseau must already be running as elixir tests fail without it. — the only other option is that we do not fail our build when elixir tests fail, which would be terrible

@nickva
Copy link
Contributor

nickva commented Jul 24, 2023

my assumption was that clouseau must already be running as elixir tests fail without it. — the only other option is that we do not fail our build when elixir tests fail, which would be terrible:

Ah that makes sense, @janl. We just never run make elixir in the CI. We run make elixir-suite. The default test suite doesn't include clouseau tests.

@janl janl changed the title fix: make elixir should pass without clousau or nouveau fix: make elixir should match what we run in CI Jul 27, 2023
@janl
Copy link
Member Author

janl commented Jul 27, 2023

thanks Nick, I finally got there independently. I suggest we remove the old elixir target and we rename elixir-suite to elixir

@janl janl requested a review from nickva July 27, 2023 09:14
Makefile Show resolved Hide resolved
Copy link
Contributor

@nickva nickva left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

The `elixir` target should run the default set that passes all tests.
The old target ran search tests that would fail without a separate
clouseau setup step. The new `elixir` target is what we actually run
in CI. This should prevent developer confusion when things pass in CI
but fail locally or vice versa.
@janl janl merged commit 3294a72 into main Jul 28, 2023
14 checks passed
@janl janl deleted the fix/nouveau-tests branch July 28, 2023 09:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants