Create a validation test with the settings of a created test
Overview
H2O Model Validation enables you to create a new test with the settings of a created test.
Instructions
caution
- Adversarial similarity
- Model: To run an adversarial similarity test on a model, you must have the Connection utilized to import the model to be on a
Connected
state. - Dataset: To run an adversarial similarity test on a dataset, you must have the Connection utilized to import the dataset to be on a
Connected
state.- Exception: If you made the dataset available in H2O Model Validation when you imported the dataset, you do not need to have the Connection utilized to import the dataset as
Connected
. In other words, if you selected the Download datasets from DAI instance checkbox when importing the dataset, you do not need to have the Connection utilized to import the dataset asConnected
.
- Exception: If you made the dataset available in H2O Model Validation when you imported the dataset, you do not need to have the Connection utilized to import the dataset as
- Model: To run an adversarial similarity test on a model, you must have the Connection utilized to import the model to be on a
- Calibration score
- To run a calibration score test on a model, you must have the Connection utilized to import the model to be on a
Connected
state.
- To run a calibration score test on a model, you must have the Connection utilized to import the model to be on a
- Segment performance
- To run a segment performance test on a model, you must have the Connection utilized to import the model to be on a
Connected
state.
- To run a segment performance test on a model, you must have the Connection utilized to import the model to be on a
- Size dependency
- To run a size dependency test on a model, you must have the Connection utilized to import the model to be on a
Connected
state.
- To run a size dependency test on a model, you must have the Connection utilized to import the model to be on a
- Backtesting
- To run a drift backtesting test on a model, you must have the Connection utilized to import the model to be on a
Connected
state.
- To run a drift backtesting test on a model, you must have the Connection utilized to import the model to be on a
- Drift detection
- Model: To run a drift detection test on a model, you must have the Connection utilized to import the model to be on a
Connected
state. - Dataset: To run a drift detection test on a dataset, you must have the Connection utilized to import the dataset to be on a
Connected
state.- Exception: If you made the dataset available in H2O Model Validation when you imported the dataset, you do not need to have the Connection utilized to import the dataset as
Connected
. In other words, if you selected the Download datasets from DAI instance checkbox when importing the dataset, you do not need to have the Connection utilized to import the dataset asConnected
.
- Exception: If you made the dataset available in H2O Model Validation when you imported the dataset, you do not need to have the Connection utilized to import the dataset as
- Model: To run a drift detection test on a model, you must have the Connection utilized to import the model to be on a
- Robustness
- To run a robustness test on a model, H2O Model Validation requires the Connection utilized to import the model to be on a
Connected
state.
- To run a robustness test on a model, H2O Model Validation requires the Connection utilized to import the model to be on a
To start a new test with the settings of a created test, consider the following instructions:
- In the H2O Model Validation navigation menu, click Tests.
- Locate the row of the test you want to reference to create the new test with the same settings as the observed test.
- Click More.
- Select New test with same settings.
Feedback
- Submit and view feedback for this page
- Send feedback about H2O Model Validation to cloud-feedback@h2o.ai