Skip to main content
Version: v1.3.0

Import dataset settings: Text span prediction

Dataset name​

Name of the dataset.

Problem category​

This setting defines a particular general problem type category, for example, image.

note
  • The selected problem category (for example, image) determines the options in the Problem type setting.
  • The following option is available when defining the settings of an experiment: From experiment.
    • The From experiment option enables you to utilize the settings of an experiment (another experiment).

Problem type​

Defines the problem type of the experiment, which also defines the settings H2O Hydrogen Torch displays for the experiment.

Note
  • The selected problem category (in the Problem category setting) determines the available problem types.
  • The selected problem type and experience level determine the settings H2O Hydrogen Torch displays for the experiment.

Train dataframe​

Defines a .csv or .pq file containing a dataframe with training records that H2O Hydrogen Torch uses to train the model.

note
  • The records are combined into mini-batches when training the model.
  • If a validation dataframe is provided, a fold column is not needed in the train dataframe.
  • You can now import datasets for inference only. To do so, when defining the setting for an experiment, set the Train dataframe setting to None while setting the Test dataframe setting to the relevant dataframe (as a result, H2O Hydrogen Torch utilizes the relevant dataset for predictions and not for training).

Validation dataframe​

Defines a .csv or .pq file containing a dataframe with validation records that H2O Hydrogen Torch uses to evaluate the model during training.

Note
  • To set a Validation dataframe requires the Validation strategy to be set to Custom holdout validation. In this case, H2O Hydrogen Torch fully respects the choice of a separate validation dataframe and does not perform any internal cross-validation. In other words, the model is trained on the full provided train dataframe, and model performance is evaluated on the provided validation dataframe.
  • The validation dataframe should have the same format as the train dataframe but does not require a fold column.

Test dataframe​

Defines a .csv or .pq file containing a dataframe with test records that H2O Hydrogen Torch uses to test the model.

note
  • The test dataframe should have the same format as the train dataframe but does not require a label column.
  • You can now import datasets for inference only. To do so, when defining the setting for an experiment, set the Train dataframe setting to None while setting the Test dataframe setting to the relevant dataframe (as a result, H2O Hydrogen Torch utilizes the relevant dataset for predictions and not for training).

Question column​

Defines the dataset column containing the question text H2O Hydrogen Torch uses during model training.

Context column​

Defines the dataset column containing text that answers the question in the question column; H2O Hydrogen Torch uses the context column during model training.

Answer column​

Defines the dataset column containing the answer text that H2O Hydrogen Torch uses during model training.

Answer start column​

Defines the dataset column, which describes the start of the answer text in the context column. If not set, H2O Hydrogen Torch chooses the first occurrence of the answer text found in the context text as the start of the answer text in the context column.

Feedback