-
Notifications
You must be signed in to change notification settings - Fork 3.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[MetaSchedule] Add JSON Database Validation Scripts #12948
[MetaSchedule] Add JSON Database Validation Scripts #12948
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. Just some nits
32cf60e
to
c531e50
Compare
Thanks for contributing to TVM! Please refer to the contributing guidelines https://tvm.apache.org/docs/contribute/ for useful information and tips. Please request code reviews from Reviewers by @-ing them in a comment. Generated by tvm-bot |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Otherwise LGTM
de13c2b
to
b0b28cb
Compare
* Add validation scripts. * Fix testing script. * Fix lint. * Fix lint. * Fix inputs. * Fix lint. * Fix lint. * Add timer func. * Fix ci. * Address comments. * Add total time statistics. * Fix lint.
* Add validation scripts. * Fix testing script. * Fix lint. * Fix lint. * Fix inputs. * Fix lint. * Fix lint. * Add timer func. * Fix ci. * Address comments. * Add total time statistics. * Fix lint.
This PR introduces a validation script to check result accuracy between the scheduled IRModules and original IRModule stored in MetaSchedule database. The validate function could also be reused for other type of databases in MetaSchedule. The result would be printed out on the screen as validation passed or failed at some records.
CC @junrushao
When running checks the expected output looks like:
If everything runs well, the script will print out a
Validation passed!
in the end.If there's any unexpected error or unmatched results, it will print out the IRModules, inputs or exceptions.