Skip to main content

Task 9: Experiment summary and AutoDoc

In this task, we will see how H2O Driverless AI allows you to download auto-generated documents such as the Experiment Summary & Logs and the MLI report, all at the click of a button.

Experiment Summary & Logs​

Click Download Summary & Logs. H2O Driverless AI will download a ZIP file.

download-summary-logs

The ZIP file contains several files that log and summarize the experiment. Take note of the following files.

  • preview.txt: provides a preview of the experiment. (This is the same information that was included on the UI before starting the experiment).
  • summary: provides the same summary that appears in the lower-right portion of the UI for the experiment. (Available in txt or json).
  • config.json: provides a list of the settings used in the experiment.
  • config_overrides_toml_string.txt: provides any overrides for this experiment that were made to the config.toml file.
  • args_do_auto_dl.json: the internal arguments used in the Driverless AI experiment based on the dataset and accuracy, time and interpretability settings.
  • experiment_column_types.json: provides the column types for each column included in the experiment.
  • experiment_original_column.json: a list of all columns available in the dataset that was used in the experiment.
  • experiment_pipeline_original_required_columns.json: for columns used in the experiment, this includes the column name and type.
  • experiment_sampling_description.json: a description of the sampling performed on the dataset.
  • timing.json: the timing and number of models generated in each part of the Driverless AI pipeline.

Generate an AutoDoc​

The AutoDoc feature is used to generate automated machine learning documentation for individual Driverless AI experiments.

Click DOWNLOAD AUTODOC to gain further insights about the experiment. This report provides insight into the training data and any detected shifts in distribution, the validation schema selected, model parameter tuning, feature evolution and the final set of features chosen during the experiment. It is an editable document relevant to a specific experiment in H2O Driverless AI.

download-autodoc

Feedback