Skip to main content
Version: v0.16.0

Create a validation test with the settings of a created test

Overview​

H2O Model Validation enables you to create a new test with the settings of a created test.

Instructions​

caution
  • Adversarial similarity
    • To run an adversarial similarity test on a model, you need to set any Connection as Worker.
    • To run an adversarial test on a dataset, you need to set any Connection as Worker, and you need to have the Connection(s) utilized to import the dataset(s) as Connected.
      • Exception: If you made the dataset(s) available in H2O Model Validation when you imported a dataset or model, you do not need to have the Connection(s) utilized to import the dataset(s) as Connected. In other words, if you selected the Download datasets from DAI instance checkbox when importing a model or dataset, you do not need to have the Connection(s) utilized to import the dataset(s) as Connected.
  • Calibration score
    • To run a calibration score test on a model, H2O Model Validation requires you to have the Connection utilized to import the model as Connected.
  • Segment performance
    • To run a segment performance test on a model, H2O Model Validation requires you to have the Connection utilized to import the model as Connected.
  • Size dependency
    • To run a size dependency test on a model, H2O Model Validation requires you to have the Connection utilized to import the model as Connected.
  • Backtesting
    • To run a backtesting test on a model, H2O Model Validation requires you to have the Connection utilized to import the model as Connected.
  • Drift detection
    • You do not need to define a Connection as Worker to run a drift detection test on a dataset or model (the datasets of a model).
      • In particular, when running a drift detection test on a dataset, you must have the Connection(s) utilized to import the datasets as Connected.
        • Exception: If you made the dataset(s) available in H2O Model Validation when you imported a dataset or model, you do not need to have the Connection(s) utilized to import the dataset(s) as Connected. In other words, if you selected the Download datasets from DAI instance checkbox when importing a model or dataset, you do not need to have the Connection(s) utilized to import the dataset(s) as Connected.

To start a new test with the settings of a created test, consider the following instructions:

  1. In the H2O Model Validation navigation menu, click Tests.
  2. Locate the row of the test you want to use as a reference to create the new test with the same settings (as the observed test).
  3. Click Kebab menu.
  4. Select New test with same settings.

new-test-with-same-settings.png

Feedback