Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Improved QA4SM metrics calculators (#219)
* temporal matching for multiple frames * don't convert timezone naive indices * combined matcher for dictionary * added option to use all with combined_dropna * comparison of new and old matching implementation This adds a test to check whether the new matching in BasicTemporalMatching works as the old one in case there are no duplicates in the reference frame. It replaced the matcher in the other tests by a dummy that still uses the old matching implementation. The following commit will remove the dummy and set the new expected values. * changed tests for ascat_ismn to use new matching * fixup for previous commit * added PairwiseIntercomparisonMetrics * fixed test for PairwiseIntercomparisonMetrics * statistics based metrics calculator * Added tests for PairwiseIntercomparisonMetrics One test still fails due to difference in scaling before calculating ubRMSD. * Added CIs to PairwiseIntercomparisonMetrics * made bootstrapped CI tests less sensitive * made bootstrapped CI tests less sensitive * added missing import * temporal matching for multiple frames * don't convert timezone naive indices * added option to use all with combined_dropna * combined matcher for dictionary * comparison of new and old matching implementation This adds a test to check whether the new matching in BasicTemporalMatching works as the old one in case there are no duplicates in the reference frame. It replaced the matcher in the other tests by a dummy that still uses the old matching implementation. The following commit will remove the dummy and set the new expected values. * changed tests for ascat_ismn to use new matching * fixup for previous commit * added PairwiseIntercomparisonMetrics * fixed test for PairwiseIntercomparisonMetrics * statistics based metrics calculator * Added tests for PairwiseIntercomparisonMetrics One test still fails due to difference in scaling before calculating ubRMSD. * Added CIs to PairwiseIntercomparisonMetrics * made bootstrapped CI tests less sensitive * made bootstrapped CI tests less sensitive * added missing import * make_combined_temporal_matcher now also works with k>2 * Fixed some issues - bug in validation.get_data_for_result_tuple - no segfault when running tests anymore * better confidence intervals for tcol * added tests for tripletmetrics * added imports * run tests all at the same time * removed imports from validation_framework init * triple metrics only * removed xarray test * fixed test * fixed test * TripleIntercomparisonMetrics -> TripleCollocationMetrics * use percentile method by default; analytical CIs for mse_bias * better test for #220
- Loading branch information