Using Data Connectors with Native Installs

The config.toml file is available in the etc/dai folder after the RPM, DEB, or TAR SH is installed. Before enabling a connector, be sure to export the Driverless AI config.toml file or add it to ~/.bashrc. For example:

# DEB and RPM
export DRIVERLESS_AI_CONFIG_FILE="/etc/dai/config.toml"

# TAR SH
export DRIVERLESS_AI_CONFIG_FILE="/path/to/your/unpacked/dai/directory/config.toml"

The sections that follow show examples that describe how to specify configuration options in the config.toml file to enable HDFS, S3, Google Cloud Storage, Google Big Query, Minio, Snowflake, kdb+, Azure Blob Store, BlueData DataTap, Hive, and JDBC data sources.

• S3 Setup
  • Description of Configuration Attributes
  • S3 with No Authentication
  • S3 with Authentication
• HDFS Setup
  • Description of Configuration Attributes
  • HDFS with No Authentication
  • HDFS with Keytab-Based Authentication
  • HDFS with Keytab-Based Impersonation
• Azure Blob Store Setup
  • Supported Data Sources Using the Azure Blob Store Connector
  • Description of Configuration Attributes
  • Example 1: Enabling the Azure Blob Store Data Connector
  • Example 2: Mount Azure File Shares to the Local File System
  • Example 3: Enable HDFS Connector to Connect to Azure Data Lake Gen 1
  • Example 4: Enable HDFS Connector to Connect to Azure Data Lake Gen 2
  • FAQ
• BlueData DataTap Setup
  • Description of Configuration Attributes
  • DataTap with No Authentication
  • DataTap with Keytab-Based Authentication
  • DataTap with Keytab-Based Impersonation
• Google Big Query Setup
  • Google BigQuery with Authentication
• Google Cloud Storage Setup
  • Description of Configuration Attributes
  • GCS with Authentication
• Hive Setup
  • Start Driverless AI
• kdb+ Setup
  • kdb+ with No Authentication
  • kdb+ with Authentication Example
• Minio Setup
  • Description of Configuration Attributes
  • Minio with Authentication
• Snowflake Setup
  • Snowflake with Authentication
  • Adding Datasets from Snowflake
• JDBC Setup
  • Tested Databases
  • Retrieve the JDBC Driver
  • Start Driverless AI
  • Adding Datasets Using JDBC
  • Query Examples
  • Adding an Untested JDBC Driver
• Data Recipe URL Setup
  • Enable Data Recipe URLs
• Data Recipe File Setup
  • Enable Data Recipe Files