Skip to main content

Settings: Adversarial attack

Overview​

H2O Model Security offers several settings for an adversarial attack. Below, each setting is described in turn.

Endpoint URL​

Defines the endpoint URL of the deployed model in H2O MLOps that H2O Model Security utilizes to score new data and obtain new predictions. To learn how to access your model's endpoint URL, see Viewing deployments.

For example, a model's endpoint URL will be as follows: https://model.cloud.h2o.ai/b49c917e-1535-4c7c-95c9-279241189046/model/score.

Model attack type​

Defines the model attack type H2O Model Security utilizes to evaluate and analyze the security of a Driverless AI (DAI) model (experiment). A model attack type centralizes and visualizes how DAI models will react in production within the constraints of the selected model attack type.

Number of features to attack​

Defines the number of features H2O Model Security will attack during the specified model attack type. H2O Model Security attacks' features from left to right. For example, if the value of this setting is two (2), the attack features in the below validation dataset (table) will be as follows: Column (feature) 1 and Column (feature) 2.

Column (feature) 1Column (feature) 2Column (feature) 3
A1@
B2$
Note

Only numeric (int) values are accepted.

Columns to exclude (, seperate)​

Defines the columns to exclude from the validation dataset, which H2O Model Security uses to score new data in the endpoint URL, which in turn applies the selected model attack type. Exclude unnecessary columns required by the model's endpoint URL request format. For example, if your deployed model's request format is as follows, but the validation dataset has a column that does not match any of the fields (line 3) in the request format, you will have to exclude such column: 

curl -X POST -H "Content-Type: application/json" -d @- https://model.cloud-internal.h2o.ai/cc957e2f-e0b8-469a-a116-463519f13af9/model/score << EOF
{
  "fields": [
    "Pclass",
    "Sex",
    "Age",
    "SibSp",
    "Parch",
    "Fare",
    "Cabin",
    "Embarked"
  ],
  "rows": [
    [
      "0",
      "text",
      "0",
      "0",
      "0",
      "0",
      "text",
      "text"
    ]
  ]
}
EOF
Feedback

You need to specify a column with its name and separate column names with commas. For example: Pclass, Parch, Embarked.

Target column​

Defines the target column of the model and the validation dataset that H2O Model Security utilizes to score new data in the endpoint URL, which in turn applies the selected model attack type.

Feedback