Basic CI integration #364
Basic CI integration #364
Conversation
MisterDA
force-pushed
the
ci-integration
branch
from
2969552
to
d2b99d7
Compare
|
I think you forgot to promote the expect test outputs - might be worth being explicit if these environment variables are set in the tests (so we can also check these are working as expected). |
MisterDA
force-pushed
the
ci-integration
branch
from
d2b99d7
to
6154ac4
Compare
This allows to show all the errors in the CI logs if multiple tests are failing. Alcotest tests themselves are not run as if they were run in CI.
MisterDA
force-pushed
the
ci-integration
branch
from
6154ac4
to
73a84a1
Compare
I've set |
|
For reference, this is the language GitHub Actions uses for annotations: Workflow commands for GitHub Actions. |
|
Many thanks! |
…d alcotest-async (1.7.0) CHANGES: - compile with MSVC (mirage/alcotest#369, @jonahbeckfordm review by @TheLortex and @MisterDA) - Allow skipping a test case from inside the test case (mirage/alcotest#368, @apeschar) - Fix compilation on bytecode architectures (mirage/alcotest#335, @glondu) - Get `alcotest_stubs.c` to compile with MSVC (mirage/alcotest#369, @jonahbeckford) - Try automatically reporting the location of calls to Alcotest.check. (mirage/alcotest#366, @MisterDA, review by @TheLortex) - Detect that Alcotest is running in CI and change output accordingly. (mirage/alcotest#364, @MisterDA) - Upgrade to `dune >= 3.0`. (mirage/alcotest#360, @MisterDA)
This PR attempts to do simple integration from Alcotest to CI systems. For now, Alcotest detects the CI system using the
CI,GITHUB_ACTIONS, orOCAMLCIenvironment variables. As a first showcase of what we can do, when detecting GitHub Actions it will output annotations allowing to fold/unfold a test suite in the web interface. When detecting it's running in CI, Alcotest will also enable the show_errors modes (this can be overridden via the API) so that all failing tests are displayed in the CI (otherwise users would have to fix the failing test, push, and so on, to see the other errors).I plan to expand the features if this PR is well received.