Extend a dataset with new data

Overview

H2O Hydrogen Torch enables you to extend a dataset with new data, for example, to increase your dataset size.

Note

H2O Hydrogen Torch does not extend a dataset in the sense that rows are combined, and duplicate rows are removed. Extend, in this case, refers to adding new dataset files to a dataset that already has certain dataset files.

Example

Consider the following two datasets (dataset one and dataset two):

dataset_one.zip                                 dataset_two.zip 
│   └───csv_one.csv                             │   └───csv_two.csv 
│   │                                           │   │
│   └───image_folder_one                        │   └───image_folder_two 
│       └───name_of_image.image_extension       │       └───name_of_image.image_extension
│       └───name_of_image.image_extension       │       └───name_of_image.image_extension
│       └───name_of_image.image_extension       │       └───name_of_image.image_extension
│       ...                                     │       ...

After extending dataset one with dataset two:

extended_dataset_one.zip 
│   └───csv_two.csv
│   └───csv_one.csv
│   │
│   └───image_folder_two
│   │   └───name_of_image.image_extension
│   │   └───name_of_image.image_extension
│   │   └───name_of_image.image_extension
│   │    ...
│   └───image_folder_one
│       └───name_of_image.image_extension
│       └───name_of_image.image_extension
│       └───name_of_image.image_extension
│       ...

Instructions

To extend a dataset with new data, consider the following instructions:

1. Open the import dataset wizard

   In the H2O Hydrogen Torch navigation menu, click Import dataset.

2. Choose a data connector

   In the Source list, select the source (data connector) that you want to use. H2O Hydrogen Torch selects Demo Dataset by default.

   Demo Dataset

   1. In the File name list, select one of the Demo (preprocessed) datasets.

   AWS S3

   1. In the S3 bucket name box, enter the name of the S3 bucket name.

   2. In the AWS access key box, enter the AWS access key.

      Note

      You don't need to enter the AWS access key if the S3 bucket is public.

   3. In the AWS secret key box, enter the AWS secret key.

      Note

      You don't need to enter the AWS secret key if the S3 bucket is public.

   4. In the File name list, select the file you want to use.

   Google Cloud Storage

   1. In the GCS bucket name box, enter the name of the Google Cloud Storage bucket.

   2. In the GCS Service Account JSON box, enter the content of Google Cloud Service Account JSON file.

   3. In the File name list, select the file you want to use.

   Kaggle

   1. In the Kaggle API command box, enter a Kaggle API command.

   2. In the Kaggle username box, enter your username.

   3. In the Kaggle secret key box, enter your kaggle secret key.

   Azure Datalake

   1. In the Datalake connection string box, enter the Datalake connection string.

   2. In the Datalake container name box, enter the Datalake container name.

   3. In the File name box, enter the file name.

   Upload

   1. Click Browse.

      • Or drag and drop the file (dataset)

   2. Click Upload.

   3. Skip step 3.

   H2O Drive

   1. In the File name list, select a dataset.

   Local

   Note

   The Local source is unavailable on instances running in H2O AI Cloud.

   1. In the File location box, enter the path to the file you want to use. The box starts at your home directory.

   2. To browse instead, click a row in the directory table. H2O Hydrogen Torch opens the folder or selects the file you click, and updates the File location box with its path.

   3. To go up one level, click ...

3. Click Continue.

4. Start the merge

   Click Merge with existing dataset.

5. Select the dataset to extend

   In the Dataset list, select the dataset you want to extend with the dataset imported above.

6. Click Merge.

7. Configure the dataset settings

   Configure the dataset settings for the dataset being extended.

   Note

   To learn about the import dataset settings, see Import dataset settings.

8. Click Continue.

9. Review the dataset preview

   Again, click Continue.

   Note

   Before you click Continue, please review the dataset preview.

---

Feedback

• Submit and view feedback for this page
• Send feedback about H2O Hydrogen Torch to cloud-feedback@h2o.ai