H2O resides in the same executor JVM as Spark. The memory provided for H2O is configured via Spark. Refer to Spark Configuration for more details.
Configure the Executor memory (i.e., memory available for H2O) via the Spark configuration property
bin/sparkling-shell --conf spark.executor.memory=5g, or configure the property in
Configure the Driver memory (i.e., memory available for H2O client running inside Spark driver) via the Spark configuration property
bin/sparkling-shell --conf spark.driver.memory=4g, or configure the property in
- Refer to the Spark Configuration documentation.
- For JVMs that require a large amount of memory, we strongly recommend configuring the maximum amount of memory available for individual mappers. For information on how to do this using YARN, refer to http://docs.h2o.ai/h2o/latest-stable/h2o-docs/faq/hadoop.html