Skip to main content
Version: v0.16.0

Create a drift detection test

Overview​

A drift detection validation test enables you to analyze a model or dataset.

Instructions​

Test a model​

note

You do not need to define a Connection as Worker to run a drift detection test on a model (the datasets of a model).

To create a drift detection test for a model, consider the following instructions:

  1. In the H2O Model Validation navigation menu, click Tests.
  2. Click the New test tab.
  3. In the Model list, select the model you want to utilize for the drift detection test.
  4. Click the Drift detection card.
    note

    After selecting a model, H2O Model Validation greys out unsupported tests while highlighting applicable tests.

  5. Define the drift detection test settings.
    note

    To learn about each setting for a Drift detection test, see Settings: Drift detection.

  6. Click Run drift detection test.

Test a dataset​

caution
  • You do not need to define a Connection as Worker to run a drift detection test on a dataset.
    • In particular, when running a drift detection test on a dataset, you must have the Connection(s) utilized to import the datasets as Connected.
      • Exception: If you made the dataset(s) available in H2O Model Validation when you imported a dataset or model, you do not need to have the Connection(s) utilized to import the dataset(s) as Connected. In other words, if you selected the Download datasets from DAI instance checkbox when importing a model or dataset, you do not need to have the Connection(s) utilized to import the dataset(s) as Connected.

To create a drift detection test for a dataset, consider the following instructions:

  1. In the H2O Model Validation navigation menu, click Tests.
  2. Click the New test tab.
  3. In the Dataset list, select the dataset you want to utilize for the drift detection test.
  4. Click the Drift detection card.
    note

    After selecting a model, H2O Model Validation greys out unsupported tests while highlighting applicable tests.

  5. Define the drift detection test settings.
    note

    To learn about each setting for a drift detection test, see Settings: Drift detection.

  6. Click Run drift detection test.
Feedback