Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support xfail/skip of optional, format, next tests #97

Merged
merged 5 commits into from
Jun 17, 2023

Commits on Apr 16, 2023

  1. Support xfail/skip of optional, format, next tests

    This adds infrastructure to generate a JSON file flagging which
    optional, format, and/or draft-next tests are expected to fail
    ("xfail") or have a bug that requires skipping them ("skip").
    The file includes both the status to annotate the test, as
    well as the reason.
    
    The --testsuite-generate-status option will run all tests and
    update the JSON file based on the current failures.  It will
    leave in place existing entries for failures so as not to overwrite
    and custom statuses or reasons.  It will remove entries for
    tests that now pass.
    
    Failing cases are set to "xfail" with an appropriate generic reason
    (format, optional, or draft-next, in that order of precedence).
    To skip a test, or provide a custom reason, edit the file manually.
    
    This commit also includes documentation in in the CONTRIBUTING
    file for test options I added a while back but apparently forgot
    to document.
    handrews committed Apr 16, 2023
    Configuration menu
    Copy the full SHA
    57c667f View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2023

  1. Clean up imports

    marksparkza committed Jun 17, 2023
    Configuration menu
    Copy the full SHA
    d8006f2 View commit details
    Browse the repository at this point in the history
  2. Tweak documentation

    marksparkza committed Jun 17, 2023
    Configuration menu
    Copy the full SHA
    d8c12fc View commit details
    Browse the repository at this point in the history
  3. Remove trailing blank

    json.dump does not add a trailing newline.
    marksparkza committed Jun 17, 2023
    Configuration menu
    Copy the full SHA
    06f8028 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    07e52b0 View commit details
    Browse the repository at this point in the history