Skip to main content
Version: v0.17.0

Settings: Segment performance

Overview​

H2O Model Validation offers an array of settings for a segment performance test. Below, each setting is described in turn.

Settings​

Test name​

This setting defines the name for the validation test. By default, H2O Model Validation assigns a name to the test that you can rewrite.

Model​

This setting defines the model H2O Model Validation utilizes to run the segment performance test.

Model train dataset​

note

Model train dataset refers to one of the model's informational points, not a setting. This informational point refers to the model's training datase

Primary dataset​

This settign defines the dataset H2O Model Validation utilizes to run the segment performance test. H2O Model Validation applies the model to the dataset, bins the data, and calculates the performance statistics.

note

The defined primary dataset needs to follow the model's training dataset format.

Metric​

This setting defines the metric to be applied to measure model performance. The list of applicable metrics depends on the model type (for example, binary classification).

Columns to drop​

Defines the columns H2O Model Validation drops when assessing the data segments.

Number of bins​

This setting defines the number of bins H2O Model Validation utilizes to split the variable values of the primary dataset. In the case of a categorical column, H2O Model Validation utilizes the appropriate categories while ranging numerical columns into a specified number of bins.

Feedback