View a validation test

H2O Model Validation offers an array of metrics when viewing a validation test to fully enable you to understand the complexity of a particular validation test type.

Instructions

To view a validation test, consider the following instructions:

1. In the H2O Model Validation navigation menu, click Test manager.
   note

   • In the test manager card, you can monitor all the completed and running validation tests.
   • To learn about the columns of the test manager table, see Test manager table columns.
   • By default, the test manager table does not refresh automatically. To automatically refresh the table, see Auto refesh test manager table.
2. In the test manager table, select the validation test you want to view.
3. Click View.
   note

   • Based on the selected validation test, certain metrics will appear:
     • Metrics: Adversarial Similarity
     • Metrics: Backtesting
     • Metrics: Drift Detection
     • Metrics: Size Dependency

Auto refesh test manager table

By default, the test manager table does not refresh automatically. To automatically refresh the table, consider the following instructions:

1. In the H2O Model Validation navigation menu, click Test manager.
2. Click the Auto-Refresh Progress toggle.
   note

   • Turning auto refresh on will reset any manual table sorting
   • H2O Model Validation stops auto refresh if any row is selected

Test manager table columns

Column name	Description
Test type	Type of validation test (e.g., Drift Detection).
Test name	Name of the validation test (e.g., Drift Detection).
Experiment	Name of a Driverless AI experiment evaluated with the running or completed validation test.
Train dataset	Train dataset of the validation test.
Reference dataset	Reference dataset of the validation test.
State	State of the validation test (e.g., Done). See Validation test states to learn about all the different states for the State column.
Progress	Progress in a percentage form of the validation test.

Validation test states

As follows are the different types of states a validation test can be in:

• NotCreated
  • H2O Model Validation has not created the validation test.
• Created
  • H2O Model Validation is created the validation test.
• Running
  • H2O Model Validation is currently running the validation test.
• Done
  • H2O Model Validation has completed the validation test.
• Deleted
  • H2O Model Validation has deleted the validation test.
• Error
  • An error occurred during the validation test.
• Timeout
  • There was not enough time to complete the validation test.

---

Feedback

• Submit and view feedback for this page
• Send feedback about H2O Model Validation to cloud-feedback@h2o.ai