Changelog ========= Version 1.9.8 (Nov 17, 2023) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Driverless: Reduced startup time by preventing unnecessary data directory checks. - Fixed inaccessible workloads when TLS is enabled. Version 1.9.7 (Sep 1, 2023) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - H2O Kubernetes: Added option to specify extra environmental variables. - Configuration: Added deprecation mode in the licensing configuration. - Driverless: Fixed authorization forward URL exploit in legacy OIDC authentication. - Security: Addressed vulnerabilities in the runtime image. - Security: Upgraded dependencies. Version 1.9.6 (Aug 7, 2023) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Helm: Added annotations and labels for H2O Cloud integration. - Helm: Added support to override the namespace where the chart is deployed to. Version 1.9.5 (Jul 13, 2023) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Driverless: Added option to toggle Triton (and CAP_SYS_NICE capability) on/off - Hadoop: Added support for Hadoop 3.3 Version 1.9.4 (May 16, 2023) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - H2O Kubernetes: Added support for H2O 3.40 - Python: Reduced excessive logging of client requests Version 1.9.3 (Apr 4, 2023) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Driverless: Added support for Driverless AI 1.10.5 - Driverless: Automatic entity migration when changing the ownership on an instance Version 1.9.2 (Mar 21, 2023) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Added support for the H2O AI Cloud Discovery Service Version 1.9.1 (Jan 25, 2023) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Kubernetes: Added support for Kubernetes 1.26 - Kubernetes: Configurable seccomp profile - Helm: Fixed support for custom CA certificates - Helm: Removed unnecessary RBAC permissions Version 1.9.0 (Dec 8, 2022) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Driverless: Added support for single-user multinode clusters - Driverless: Fixed maximum uptime detection - Sparkling Water: Added support for the latest version of Sparkling Water - Kubernetes: Disabled auto-mounting of service account tokens - Kubernetes: Set specific secure default for Pod seccomp profile - Python: Removed tokens from Python client logging - Helm: Added support for custom CA certificates Version 1.8.14 (Sep 13, 2022) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Driverless: Added ability to change instance ownership - Profiles: Fixed updating of users roles - Reporting: Fixed session ready time being overwritten Version 1.8.13 (Jul 12, 2022) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Kubernetes: Improved resiliency to K8S API connectivity disruptions - Kubernetes: Added support for marking engines as experimental - Driverless: Improved resiliency to DAI API connectivity disruptions - H2O Kubernetes: Fixed XGBoost functionality on clusters with additional security hardening - H2O Kubernetes: Fixed cluster duration reporting - H2O Kubernetes: Stopped cluster are now correctly referred to as "Terminated" in the UI - Authentication: Fixed issues with usernames containing special characters - Helm: Added option to preserve state (PVC) after deleting a Helm release - Helm: Added option to include Openshift specific RBAC roles - Python: Fixed a regression in the Python API Version 1.8.12 (May 11, 2022) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Driverless: Added an opt-in support for v2 OIDC authentication - Kubernetes: Added an option to disable a profile - Authentication: Added support for OIDC ACR values - Python: Added a function to upgrade Driverless AI instances - R Client: Fixed Windows connection errors by replacing RCurl with httr - Security: New Kubernetes runtime Docker image - Security: Additional hardening of Kubernetes deployed workloads - Helm: Allow to pass extra env to Steam container - Helm: Added support for v1 of Ingress Version 1.8.11 (Feb 3, 2022) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Log4j: Added automatic patching for H2O-3 engines containing vulnerable JAR files - H2O Kubernetes: Added support for R client - H2O Kubernetes: Added configurable startup options per profile - H2O Kubernetes: Fixed dataset parameter calculator - H2O Kubernetes: Fixed Flow directory not being in a writeable location - Driverless: Expanded logs to include DAI logs of previous run - Driverless: Improved startup indication of NotTriggerScaleUp event - Driverless: Fixed instance upgrade for deleted engine versions - Driverless: Fixed instance link being visible to admin users - OIDC: Added expiry information to OidcTokenProvider - OIDC: Fixed admin role not cleared properly when loosing admin privileges - OIDC: Fixed personal access token in R client - Python: Fixed admin user not being able to act upon instances of other users - Documentation: Added H2O AI Cloud specific user documentation - Documentation: Added H2O on K8S examples to Python client docs Version 1.8.10 (Dec 2, 2021) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - LDAP: Added support for multiple authentication servers - Kubernetes: Added support for manually mounted volumes - Driverless: Fixed support for Driverless AI 1.10.1 - Driverless: Improved startup time - Driverless: Added option to rename instances for regular users - Driverless: Added option to Stop instances that are in Connecting state - H2O Kubernetes: Fixed engine sorting - Web UI: Added configurable support email address - Sparkling Water: Fixed Jupyterhub database migration - Helm: Fixed service annotations - Docs: Fixed generate Python client admin documentation - Security: Fixed reported security vulnerabilities Version 1.8.9 (Oct 20, 2021) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Driverless: Added support for renaming instances - Driverless: Added support for increased shared memory - Driverless: Fixed race condition in the reconciliation logic - Driverless: Fixed fetching logs when init containers are in use - H2O Kubernetes: Added ability to download logs from failed clusters - Kubernetes: Added option to disable Host Path mount type - Web Client: Fixed idle and up times for failed instances - Web Client: Fixed frontend idle timeout not redirecting to the correct login page - Python Client: Fixed Conda Python 2.7 client - Python Client: Fixed DAI Python client download on shared systems - Security: Fixed reported security vulnerabilities - Documentation: Added a startup option to disable this feature - Installation: Added configurable Livy and Jupyterhub ports Version 1.8.8 (Aug 26, 2021) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Kubernetes: Expanded functionality of init containers - Driverless Kubernetes: Added support Driverless AI 1.10 - Driverless Kubernetes: Added an info screen for stopped instances - Driverless Kubernetes: Fixed position of the "Refresh" button on the logs screen - H2O Kubernetes: Added support for launching a copy of existing H2O cluster - H2O Kubernetes: Added support for older H2O-3 K8S releases - H2O Kubernetes: Fixed H2O usage report download - Sparkling Water: Added support for Jupyter notebooks owned and stored in user location - Web UI: Fixed dropdown in Volume Mounts not updating state - OIDC: Fixed users not being re-created when identity changes - LDAP: Fixed search filter escaping - Security: Added options to define if administrators can stop and delete instances/clusters - Security: Added Secure Cookie flag option - Security: Disabled autocompletion on the login screen - Security: Updated dependencies - Python: Added get_instances to DriverlessClient - Python: Added AdminClient.enable_dai_kubernetes & AdminClient.enable_h2o_kubernetes - Python: Fixed error with AdminClient.delete_user_resources - Docs: Fixed container tolerations & init containers help text Version 1.8.7 (Jul 15, 2021) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Added configurable global prefix for all Steam URLs - Kubernetes: Added support for init containers - Kubernetes: Added support for tolerances - Kubernetes: New smaller Docker image for Steam on Kubernetes only - Kubernetes: Improved timeout failure error description - Driverless Kubernetes: Fixed restarting instances through Python client - Driverless Kubernetes: Fixed status refresh rate for running instances - H2O Kubernetes: Fixed issues with empty GPU Resource Name - H2O Hadoop: Reduced IO load when submitting Hadoop jobs - H2O Hadoop: Added support for SSL JDBC URL - H2O Hadoop: Improved environment logging - Security: Added option to not serve non-TLS requests - Docs: Improved Kubernetes CPU definition - Docs: Improved Hadoop impersonation guide - Installation: Helm: Removed wildcard resources from Role Version 1.8.6 (Jun 15, 2021) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - H2O Hadoop: Added configurable prefix for output directory - H2O Kubernetes: Fixed external XGBoost crash - Driverless Kubernetes: Fixed logging issue that can cause out of memory crashes - Python Client: Added option to establish http connection to Steam server - Documentation: Added troubleshooting steps for Sparkling Water on Hadoop Version 1.8.5 (Jun 2, 2021) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Driverless Kubernetes: Added option to specify Load Balancer source ranges - H2O Kubernetes: Fixed Forbidden error with non unique cluster names - Sparkling Water: Added configurable YARN job prefix - Kubernetes: No longer setting security context if no UID or GID is provided - Kubernetes: Added support for automatic restarts when using Linkerd - Kubernetes: Added ability to trace cluster launch events - Profiles: Fixed duplicate profiles appearing to users - R Client: Fixed launching H2O cluster Version 1.8.4 (Apr 30, 2021) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Driverless AI: Added user-configurable config.toml feature - Auth: Fixed "Bcrypt" error when logging in - Auth: Fixed "Too Many Redirect" error when admin account is disabled - OIDC: Fixed Python login invaliding refresh token - Web Client: Fixed typo on the H2O-3 cluster sizing screen - Docs: Fixed issues with searching in documentation - Docs: Fixed "Getting Started" R Client documentation - Licensing: Fixed license manager validation Version 1.8.3 (Apr 22, 2021) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Driverless Kubernetes: Added configurable timeout to profiles - Driverless Kubernetes: Added option to change profile of existing instances - H2O Kubernetes: Fixed cluster list sorting - Multinode Kubernetes: Allowed cluster name reuse - Multinode Kubernetes: Added error message when started by non-oidc user - Kubernetes: Fixed special characters in usernames causing failed clusters/instances - H2O Hadoop: Timeout parameter now applies to the execution of hadoop commands as well - Sparkling Water: Fixed Spark properties not accepting multiple values - Python Client: Added support for multiple client connections in one Python session - Python Client: Added admin method for terminating all clusters/instances of a user - Python Client: Added backend_version_override for Driverless connection - Python Client: Added no_proxy argument for h2osteam.login - Login: Changed login button text and added option to hide the administrator access button - Localization: Fixed issues with Turkish user input Planned deprecations '''''''''''''''''''' - Python Client: use of static methods of `DriverlessClient`, `MultinodeClient` and `H2oKubernetesClient` will be removed in the 1.9 version in favor of class methods - Python Client: class `SteamClient` and all of its methods will be removed in the 1.9 version in favor of dedicated clients `H2oClient` and `SparklingClient` Version 1.8.2 (Apr 7, 2021) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - H2O on Hadoop: Added support for fault tolerant Grid Search - H2O on Kubernetes: Added support for overriding Java and H2O arguments - Sparkling Water on Hadoop: Added support for connecting to the underlying H2O cluster thorough the Python client - Kubernetes: Added support for profile defined Pod labels and annotations - OIDC: Added support for Personal Access Token - OIDC: Added support for IDPs with single use refresh tokens - OIDC: Added support for supplying fresh access token to Driverless AI client - OIDC: Added support for configurable logout link - OIDC: Fixed race condition when refreshing tokens - PAM: Added support for user groups - Local: Added support for Roles in local authentication mode - Security: Added an option to disable the default admin user - Licensing: Added support for uploading license via the Python client - Helm Installation: Fixed PersistentVolumeClaim override not applying - Helm Installation: Added configurable Pod labels and metadata - Autodoc: Removed autodoc integration - Documentation: Added link between user and admin guide - Documentation: Improved Driverless AI documentation Version 1.8.1 (Mar 2, 2021) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - New Feature: Added support for external H2O XGBoost cluster on Kubernetes - New Feature: Added support for H2O internode security on Kubernetes - New Feature: Added support for usage reporting for H2O on Kubernetes - New Feature: Added support for mounting Kubernetes volumes to H2O - H2O: Fixed cluster saving when timeout was reached - Sparkling Water: Added support for Sparkling Water 3.32 - OpenID: Improved token validation and refreshing - OpenID: Fixed enabling OpenID authentication - Licensing: Added support for H2O License Manager for Driverless AI - Licensing: Added support for new Steam license format - Security: Prevent configurations passed as Env Vars to be persisted on disk - Documentation: Added R client PDF documentation for offline use - Python Client: Disabled strict version check - Python Client: Fixed issue that prevented connection to OpenID secured instances using own DAI client - Web Client: Stopped blocking browsers that are not Chrome or Firefox - Web Client: Improved loading indicators - Helm Installation: Added support for new IngressClass name parameter Version 1.8.0 (Feb 1, 2021) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - New Feature: Added support for H2O-3 on Kubernetes - New Feature: Added support for Multinode Driverless AI clusters - New Feature: Added support for saving and restoring state of H2O clusters on Hadoop - Kubernetes: Added option to specify pull policy and pull secret when creating engines - Kubernetes: Added support for custom Load Balancer annotations - Kubernetes: Added configurable fallback UID/GID for launching Pods - Kubernetes: Fixed incorrect GPU usage on GPU hosts - Authentication: Added configurable session duration - Python Client: Added support for login with OpenID access/refresh token - OpenID: Obtaining Personal Access Token returns the OpenID refresh token - OpenID: Added support for nested claims in OIDC tokens - Configuration: Added support for configuration through environmental variables - Installation: Helm: Fixed LoadBalancer port not being respected - Documentation: Fixes and improvements to Steam documentation Version 1.7.7 (Dec 17, 2020) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - H2O: Improved automatic cluster sizing to support binary file formats - Driverless AI: Added missing max_idle_h and max_uptime_h parameters in the Python Client - Driverless AI: Prevent attempts to connect to non-running instance with the Python Client - Driverless AI: Fixed an issue when upgrading instances - Driverless AI: Fixed an issue that caused instances to fail prematurely - Driverless AI: Fixed server assignment for the h2o-agent backend - Driverless AI: Deprecated h2o-agent backend in favor of kubernetes backend - Sparkling Water: Fixed an issue with data import from Kerberized Hive - OpenID: Added support for Google OpenID provider - OpenID: Fixed metadata validation - OpenID: Improved group membership extraction and logging - LDAP: Prevent group search when no group configuration was provided - LDAP: Fixed group search issue with certain LDAP providers - Profiles: Fixed issue when matching roles to profiles - Profiles: Fixed duplicate profiles on selection screen - Users: Disable profile assignment checkboxes that would have no effect - Users: Added an option to manually override the admin user - Python Client: Now downloadable from Web Client - Python Client: Added toml dependency for Driverless AI Client - Autodoc: Upgraded autodoc to 1.0.3-301 - Installation: Switched from initv to systemd for RPM installations - Installation: Added support for Helm v2 Version 1.7.6 (Nov 3, 2020) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Driverless AI: Added integration with ModelOps (h2oai-storage) - Driverless AI: Added support for profile resource limits - Driverless AI: Added UI elements to see status of starting instances - Driverless AI: Added data export to monitor usage - Driverless AI: Fixed profile instance limit not being honored - Driverless AI: Fixed permission errors when launching instances with custom UID - Driverless AI: Fixed administrators being able to Start and Terminate instances of regular users - H2O: Started logging shutdown events into H2O logs - Autodoc: Upgraded H2O Autodoc to v1.0.3-279 - Kubernetes: Cluster-wide RBAC permissions are no longer required - Kubernetes: Automatically detect Namespace - Kubernetes: Automatically detect default StorageClass - Kubernetes: Added support for amd.com/gpu - OpenID: Added support for mapping OpenID groups to roles and profiles - OpenID: Automatically detect correct login/logout URLs - OpenID: Logout will now correctly end OpenID session - OpenID: Fixed passing of access tokens between applications - Roles: Reworked the Roles screen to map user groups to Steam roles - Licensing: Improved the License screen to accept license strings in addition to license files - Licensing: Added support for LicenseManager issued licenses - Docker: Reduced the size of the Docker image Version 1.7.5 (Sep 29, 2020) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - H2O: Increased timeout for initial connection to the cluster - Driverless AI: When enabled, instances are protected with OpenID authentication - Driverless AI: Added support for Minio connector - Driverless AI: Pass sensitive config.toml values as Secrets on Kubernetes - Driverless AI: Added ability to download logs from failed/stopped instances - Driverless AI: Instances now use the correct amount of cores instead of all cores - Helm: Added Ingress example - Helm: Allow mounting of additional volumes to Enterprise Steam - Helm: Allow configurable runAsUser - Fixed http to https redirect to prevent issues when deployed behind reverse proxy - Fixed issue with Driverless AI profile selector in Web Client - Fixed invisible instance name requirements in Web Client - Fixed RPM installation warning Version 1.7.4 (Sep 14, 2020) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Installation: Created Helm Chart for installation on Kubernetes - Python Client: Added automatic cluster sizing for H2O and Sparkling Water - Documentation: Added Getting Started guide for Python client - Autodoc: Upgraded H2O Autodoc to v1.0.2-256 and added support for new parameters - Fixed Rsparkling for Sparkling Water >3.28.0.4 - Fixed Driverless instance license is not updated when global DAI license changes - Fixed error when launching an instance with extra env variables from profiles - Fixed error when configuring authentication other than OpenID Version 1.7.3 (Sep 2, 2020) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - New Feature: Added support for external H2O XGBoost cluster - New Feature: Added support for OpenID connect authentication - New Feature: Added support for PAM authentication - New Feature: Added management of Kubernetes volumes - Driverless AI: Added support for HDFS and Hive data connectors - Driverless AI: Added monitoring and limits for idle and uptime - Driverless AI: Existing instance storage can now be expanded if supported by Kubernetes StorageClass - Driverless AI: Additional environmental variables can be passed to the instance using a profile - Driverless AI: Instance are now started using user's UID and GID if provided - Autodoc: Upgraded H2O Autodoc to v1.0.2-254 - Kubernetes: All Kubernetes objects created by Enterprise Steam are now properly labeled - Logging: Support bundle now also contains Steam configuration and logs if exported by an administrator - Configuration: Exported configuration can now be automatically loaded on first launch to help fully scripted installations - H2O, Sparkling Water, Driverless AI: Stuck clusters/instance can be marked as failed and deleted - Fixed incorrect validation of Driverless AI storage on instance restart - Fixed "database is locked" error when database is under heavy load - Fixed Sparkling Water memory overhead calculation for XGBoost - Fixed incorrect archive extension with H2O R package - Fixed an error when R Client failed to connect to H2O cluster Version 1.7.2 (Jul 9, 2020) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - New Feature: Added managed Driverless AI Python client - Licensing: License is now accepted as base64 encoded file as well - Web Client: Added a profile option to enable old cluster launch screen - Web Client: Fixed missing Sparkling Water driver parameters - Web Client: Fixed an error with unassigned Python environments - Web Client: Fonts now display properly on offline installations - Python Client: Fixed an issue with importing engines - Installation: Upgrade now preserves ownership of Steam files and directories - Documentation: Greatly improved the user documentation - Documentation: Fixed Driverless AI examples in Python client documentation Version 1.7.1 (Jun 8, 2020) ~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Web Client: Added H2O logs to the Logs screen and download bundle - Web Client: Fixed Conda environment upload - Python Client: Added backward compatibility with Enterprise Steam v1.6 - Python Client: Fix for cacert bundle not being used when connecting to H2O - Driverless Kubernetes: Fixed liveness probe being too strict in some cases - Autodoc: Updated autodoc - Autodoc: Added Autodoc logs to the Logs screen and download bundle - Installation: Added support for high availability installation - Documentation: Documented high availability installation - Authentication: Login sessions now persist across Enterprise Steam restarts - Dependencies: Upgraded dependencies Version 1.7.0 (May 25, 2020) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Major: Added support for running Enterprise Steam inside Kubernetes cluster - Major: Added support for deploying and managing Driverless AI instances on Kubernetes - Major: Added support for ML-Autodoc for automated H2O model documentation - Web Client: Redesigned the Web client for managing H2O/Sparkling Water clusters and Driverless AI instances - Web Client: Added automatic H2O and Sparkling Water cluster sizing when launching clusters - Web Client: Added support for displaying and downloading YARN logs of H2O and Sparkling Water clusters - Web Client: Added support for displaying and downloading H2O driver logs - Web Client: Added support for displaying and downloading Sparkling Water spark-submit logs - Web Client: Added support for displaying lifecycle events of H2O/Sparkling Water clusters and Driverless AI instances - Web Client: Added support for launching copies of H2O and Sparkling Water clusters - Web Client: Improved validation when launching H2O/Sparkling Water clusters and Driverless AI instances - Python Client: New API client - R Client: New API client - H2O: Added configuration to add YARN job name prefix - H2O: Added support for importing engine from the server - Sparkling: Added support for importing engine from the server - Sparkling: Added configuration to add extra JARs to the classpath - Sparkling: Added configurable maximum idle and uptime for clusters - Documentation: New documentation for Python client - Documentation: New documentation for R client - Documentation: New documentation for using ML-Autodoc with Enterprise Steam - Installation: Simplified installation and upgrade - Installation: Moved initial administrator setup from CLI to the Web Client - Installation: Added separate directories for static assets and data to support high availability deployments - Dependencies: Upgraded dependencies - Dependencies: Replaced HAProxy with Traefik - Various other fixes and improvements Version 1.6.7 (Apr 28, 2020) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Fixed issue with environments containing multiple Spark installations Version 1.6.6 (Apr 20, 2020) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Added support for Hive in H2O and Sparkling Water - Added support for Sparkling Water engines 3.28.1.1 and higher - Added option to allow insecure XGBoost - Fixed parsing of Spark properties containing '=' - Fixed possible corruption of HAProxy configuration Version 1.6.5 (Mar 2, 2020) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Fixed custom Hadoop temporary directory to be part of HADOOP_CLIENT_OPTS Version 1.6.4 (Feb 12, 2020) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Fixed error in Hadoop Helper for Java 7 Hadoop distributions - Fixed error when creating Python environment with the same name as deleted environment - Improved validation and documentation for LDAPs with internal certificate authority - Improved documentation for Driverless AI config.toml override - Improved documentation for Driverless AI installation prerequisites Version 1.6.3 (Jan 31, 2020) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Supports RSparkling 3.28 - Use Hadoop Tmp Dir for Hadoop Helper commands to prevent slowdowns - Fixed an issue with old DAI servers preventing instances from loading - Fixed server panic with invalid LDAP over TLS configuration - Fixed initial LDAP config requiring server restart Version 1.6.2 (Jan 20, 2020) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Supports Sparkling Water 3.28 - Fixed LDAP over TLS - Fixed SAML token login in R client - Fixed H2O profile not saving YARN queues Version 1.6.1 (Jan 14, 2020) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Fixed mutual TLS setup - Fixed Driverless AI version parser - Add datatable_strategy WRITE to default DAI launch config - Add Driverless AI instance password to the instance details - Docs: Updated copyright year to include 2020 Version 1.6.0 (Dec 18, 2019) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Complete UI overhaul of configuration page for administrators. - New administrator settings for individual products and deployment backends and other configuration. - Improved UI/UX experience. - Moved most of the settings from steam.yaml into the administrator configuration in Steam UI. - Configuration file steam.yaml is no longer required. - Enabling Hadoop backend now thoroughly validates all settings to ensure they are correct (Proxyuser, Kerberos, ...). - Added ability to export and import configuration. - Several settings no longer require Enterprise Steam restart. - Added indicator when Enterprise Steam needs to restart to apply changes. - Added option to use existing Livy server for Sparkling Water as long as it is on the same host as Enterprise Steam. - HAProxy comes bundled and does not need to be installed separately. - Steam Hadoop Helper (Steam Manager) comes bundled and does not need to be installed separately. - Additional HADOOP_CLASSPATH options can be added when launching H2O clusters. - Added ability to download complete Enterprise Steam logs from the UI. - Added SAML configuration validation. - Added cacert option when connecting to Steam or H2O clusters via Python client. - Added option to ensure internal secure connections with H2O and Sparkling Water clusters. - Added warning when uploading non-Hadoop version of H2O engine. - Improved database migration. - Improved validation of H2O Launch Parameters. - Fixed bug where Sparkling Water could not launch when users reused cluster names. - Fixed bug where Sparkling Water could not launch when the cluster name contained spaces. - Fixed UI issue when uploading Python environments with the same name. - Fixed Python environment selection when no Python environments assigned. - Fixed auto-assigment of profiles to LDAP groups Version 1.5.1 (Nov 21, 2019) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Fixed a database migration bug affecting new installations. Version 1.5.0 (Oct 10, 2019) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Added ability to launch Driverless AI instances. - Added ability to use Conda environments with Sparkling Water Version 1.4.11 (Oct 1, 2019) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Fix token authentication in Python client when SAML is used - Fix R and Python client when internal and external ports do not match - Support recent versions of Sparkling Water Version 1.4.10 (Jul 19, 2019) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Added an ability to download H2O logs from Steam UI - Added a config option for custom KRB5_CONFIG (STEAM_KRB5_CONFIG) - Added support for templating in YARN queue names - Added a check to ensure the Spark version and Sparkling Water version match - Added a check to warn admin if Steam port is occupied - Improved fetching of H2O YARN job status to now use impersonation - Fixed h2osteam Conda package - Fixed issue when Sparkling Water cluster failed to start when SPARK_YARN_MODE property was set Version 1.4.9 (May 21, 2019) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Added Conda packages for Python client - Added ability to delete multiple stopped clusters at the same time - Added Python PySpark path configuration to profile - Added YARN queue configuration to user setting - Removed the need for secondary external port - Configuration fields are now protected from trailing and leading whitespace characters - Updated pysparkling dependencies for Python2 - Fixed an issue with YARN usernames being lowercased when they were not configured to do so Version 1.4.8 (Apr 15, 2019) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Add support for RSparkling through Jupyter notebook - Add option to disable Jupyterhub - Expose internal address and node ID for H2O cluster in the Steam Web UI - Add option to specify path to custom Pyspark Python for Sparkling Water - Fix pysparkling dependencies for Python3 - Updated engine upload backend Version 1.4.7 (Apr 3, 2019) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Fix Sparkling Water proxy issue with upercase usernames - Improve uploading h2o-3 engines - Set SPARK_YARN_MODE correctly based on the hadoop distribution Version 1.4.6 (Apr 1, 2019) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Added ability to choose H2O-3 Leader Node when starting a cluster - Added ability to control the number of clusters a user can spin per cluster profile - Added option to select default Sparkling Water backend - Added automatic redirection back to login with an expired session cookie - Added an ability to auto-assign Steam profiles according to SAML profiles - Docs: Add "Before you begin installation" section - Docs: Documented steam.yaml configuration options - Docs: Updated documentation - Fix an issue when Steam was hitting API endpoints of dead clusters - Fix and issue when hadoop-unjar files were not deleted from temp directory - Fix issue with upercase usernames and Sparkling Water on Hadoop Version 1.4.5 (Mar 22, 2019) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Added Configurable Steam Web UI timeout (STEAM_WEB_UI_TIMEOUT_MIN) Version 1.4.4 (Feb 20, 2019) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Make log file permissions configurable (STEAM_LOG_PERMISSIONS) - H2O: Communicate with cluster using leader node only - SW: Added support for Hive tables - SW: Disable Spark dynamic allocation for internal backend - SW: Bundle and distribute all pysparkling dependencies - LDAP group configuration is no longer mandatory - Bug fixes for Jupyterhub - Bug fixes for Sparkling Water params - Bug fixes for CDH5 Version 1.4.3 (Jan 29, 2019) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Added ability to provide secure HTTP headers (SERVER_STRICT_TRANSPORT, SERVER_X_XSS_PROTECTION, SERVER_CONTENT_SECURITY_POLICY) - Improved logging output, time in UTC - Accept encrypted TLS private keys - Log files permissions elevated for the group - Bug fixes for HDP Spark - Bug fixes for Sparkling Water integration - Bug fixes for Steam Python API - Bug fixes for LDAP connector - Bug fixes for Jupyterhub - Bug fixes for Steam Web UI Version 1.4.2 (Jan 1, 2019) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Add ability to upload H2O engine jar from Python/R API - Remove cluster dialog waits until cluster has been shut down - Log successful logins - Log files permissions reduced - Steam nbextension shows "please wait" when changing clusters - Document setup and troubleshooting steps for Hadoop/Kerberos configuration - Bug fixes Version 1.4.1 (Dec 3, 2018) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Enable Sparkling Water API from API - Hide disabled user with a checkbox - Display message if there are no clusters to show - Fix glibc dependency for steam binary - Fix documentation version - Add release notes to documentation Version 1.4.0 (Nov 23, 2018) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~ - Add Sparkling Water integration - Add SAML authentication - Add More detailed cluster profiles - New cluster overview - New launch cluster page - Add option to generate Personal access tokens