Skip to main content
Version: v0.17.0

Create a validation test with the settings of a created test

Overview​

H2O Model Validation enables you to create a new test with the settings of a created test.

Instructions​

caution
  • Adversarial similarity
    • Model: To run an adversarial similarity test on a model, you must have the Connection utilized to import the model to be on a Connected state.
    • Dataset: To run an adversarial similarity test on a dataset, you must have the Connection utilized to import the dataset to be on a Connected state.
      • Exception: If you made the dataset available in H2O Model Validation when you imported the dataset, you do not need to have the Connection utilized to import the dataset as Connected. In other words, if you selected the Download datasets from DAI instance checkbox when importing the dataset, you do not need to have the Connection utilized to import the dataset as Connected.
  • Calibration score
    • To run a calibration score test on a model, you must have the Connection utilized to import the model to be on a Connected state.
  • Segment performance
    • To run a segment performance test on a model, you must have the Connection utilized to import the model to be on a Connected state.
  • Size dependency
    • To run a size dependency test on a model, you must have the Connection utilized to import the model to be on a Connected state.
  • Backtesting
    • To run a drift backtesting test on a model, you must have the Connection utilized to import the model to be on a Connected state.
  • Drift detection
    • Model: To run a drift detection test on a model, you must have the Connection utilized to import the model to be on a Connected state.
    • Dataset: To run a drift detection test on a dataset, you must have the Connection utilized to import the dataset to be on a Connected state.
      • Exception: If you made the dataset available in H2O Model Validation when you imported the dataset, you do not need to have the Connection utilized to import the dataset as Connected. In other words, if you selected the Download datasets from DAI instance checkbox when importing the dataset, you do not need to have the Connection utilized to import the dataset as Connected.
  • Robustness
    • To run a robustness test on a model, H2O Model Validation requires the Connection utilized to import the model to be on a Connected state.

To start a new test with the settings of a created test, consider the following instructions:

  1. In the H2O Model Validation navigation menu, click Tests.
  2. Locate the row of the test you want to reference to create the new test with the same settings as the observed test.
  3. Click More.
  4. Select New test with same settings.

new-test-with-same-settings.png

Feedback