Using Data Connectors with Native Installs

The config.toml file is available in the etc/dai folder after the RPM, DEB, or TAR SH is installed. Before enabling a connector, be sure to export the Driverless AI config.toml file or add it to ~/.bashrc. For example:

# DEB and RPM
export DRIVERLESS_AI_CONFIG_FILE="/etc/dai/config.toml"

# TAR SH
export DRIVERLESS_AI_CONFIG_FILE="/path/to/your/unpacked/dai/directory/config.toml"

The sections that follow shows examples describing how to use environment variables in the config.toml file to enable HDFS, S3, Google Cloud Storage, Google Big Query, Minio, Snowflake, kdb+, Azure Blob Store, and BlueData DataTap data sources.

• S3 Setup
  • Description of Configuration Attributes
  • S3 with No Authentication
  • S3 with Authentication
• HDFS Setup
  • Supported Hadoop Platforms
  • Description of Configuration Attributes
  • HDFS with No Authentication
  • HDFS with Keytab-Based Authentication
  • HDFS with Keytab-Based Impersonation
• Azure Blob Store Setup
  • Description of Configuration Attributes
  • Azure Blob Store Example
• BlueData DataTap Setup
  • Description of Configuration Attributes
  • DataTap with No Authentication
  • DataTap with Keytab-Based Authentication
  • DataTap with Keytab-Based Impersonation
• Google Big Query
  • Google BigQuery with Authentication
• Google Cloud Storage Setup
  • GCS with Authentication
• kdb+ Setup
  • kdb+ with No Authentication
  • kdb+ with Authentication Example
• Minio Setup
  • Minio with Authentication
• Snowflake
  • Snowflake with Authentication