Class/Object

ai.h2o.sparkling

H2OContext

Related Docs: object H2OContext | package sparkling

Permalink

class H2OContext extends H2OContextExtensions

Create new H2OContext based on provided H2O configuration

Self Type
H2OContext
Linear Supertypes
H2OContextExtensions, ShellUtils, RestApiUtils, RestCommunication, RestEncodingUtils, Logging, Serializable, Serializable, Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. H2OContext
  2. H2OContextExtensions
  3. ShellUtils
  4. RestApiUtils
  5. RestCommunication
  6. RestEncodingUtils
  7. Logging
  8. Serializable
  9. Serializable
  10. Logging
  11. AnyRef
  12. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. object LoggingLevel extends Enumeration

    Permalink
    Definition Classes
    RestCommunication
  5. def asH2OFrame(s: String): H2OFrame

    Permalink

    Create a new H2OFrame based on existing Frame referenced by its id.

  6. def asH2OFrame(ds: SupportedDataset, frameName: Option[String]): H2OFrame

    Permalink
  7. def asH2OFrame(ds: SupportedDataset, frameName: String): H2OFrame

    Permalink
  8. def asH2OFrame(ds: SupportedDataset): H2OFrame

    Permalink

    Transforms Dataset[Supported type] to H2OFrame

  9. def asH2OFrame(df: DataFrame, frameName: Option[String] = None, featureColumns: Option[Seq[String]] = None): H2OFrame

    Permalink
  10. def asH2OFrame(df: DataFrame, frameName: String): H2OFrame

    Permalink
  11. def asH2OFrame(df: DataFrame, featureColumns: Seq[String]): H2OFrame

    Permalink
  12. def asH2OFrame(df: DataFrame): H2OFrame

    Permalink

    Transform DataFrame to H2OFrame

  13. def asH2OFrame(rdd: SupportedRDD, frameName: Option[String]): H2OFrame

    Permalink
  14. def asH2OFrame(rdd: SupportedRDD, frameName: String): H2OFrame

    Permalink
  15. def asH2OFrame(rdd: SupportedRDD): H2OFrame

    Permalink

    Transforms RDD[Supported type] to H2OFrame

  16. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  17. def asRDD[A <: Product](implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[A], arg1: ClassTag[A]): AnyRef { def apply(fr: ai.h2o.sparkling.H2OFrame): org.apache.spark.rdd.RDD[A] }

    Permalink

    A generic convert of Frame into Product RDD type

    A generic convert of Frame into Product RDD type

    Consider using asH2OFrame since asRDD has several limitations such as that asRDD can't be used in Spark REPL in case we are RDD[T] where T is class defined in REPL. This is because class T is created as inner class and we are not able to create instance of class T without outer scope - which is impossible to get.

    This code: hc.asRDD[PUBDEV458Type](rdd) will need to be call as hc.asRDD[PUBDEV458Type].apply(rdd)

  18. def asRDD[A <: Product](fr: H2OFrame)(implicit arg0: scala.reflect.api.JavaUniverse.TypeTag[A], arg1: ClassTag[A]): RDD[A]

    Permalink

    Convert given H2O frame into a Product RDD type

    Convert given H2O frame into a Product RDD type

    Consider using asH2OFrame since asRDD has several limitations such as that asRDD can't be used in Spark REPL in case we are RDD[T] where T is class defined in REPL. This is because class T is created as inner class and we are not able to create instance of class T without outer scope - which is impossible to get.

  19. def asSparkFrame(s: String): DataFrame

    Permalink
  20. def asSparkFrame(s: String, copyMetadata: Boolean): DataFrame

    Permalink
  21. def asSparkFrame(fr: H2OFrame, copyMetadata: Boolean = true): DataFrame

    Permalink
  22. val backend: SparklingBackend

    Permalink

    Used backend

    Used backend

    Attributes
    protected
  23. def checkResponseCode(connection: HttpURLConnection, confirmationLoggingLevel: LoggingLevel = Info): Unit

    Permalink
    Definition Classes
    RestCommunication
  24. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. def collectPropertiesDoc(): Map[String, String]

    Permalink
    Attributes
    protected
    Definition Classes
    H2OContextExtensions
  26. def delete(endpoint: URI, suffix: String, conf: H2OConf): Unit

    Permalink

    endpoint

    An address of H2O node with exposed REST endpoint

    suffix

    REST relative path representing a specific call

    conf

    H2O conf object

    Attributes
    protected
    Definition Classes
    RestCommunication
  27. def delete[ResultType](endpoint: URI, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty, skippedFields: Seq[(Class[_], String)] = Seq.empty, encodeParamsAsJson: Boolean = false)(implicit arg0: ClassTag[ResultType]): ResultType

    Permalink

    ResultType

    A type that the result will be deserialized to

    endpoint

    An address of H2O node with exposed REST endpoint

    suffix

    REST relative path representing a specific call

    conf

    H2O conf object

    params

    Query parameters

    skippedFields

    The list of field specifications that are skipped during deserialization. The specification consists of the class containing the field and the field name.

    returns

    A deserialized object

    Definition Classes
    RestCommunication
  28. def downloadBinaryURLContent(endpoint: URI, suffix: String, conf: H2OConf, file: File): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    RestCommunication
  29. def downloadH2OLogs(destinationDir: String, logContainer: String): String

    Permalink
    Definition Classes
    H2OContextExtensions
  30. def downloadStringURLContent(endpoint: URI, suffix: String, conf: H2OConf, file: File): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    RestCommunication
  31. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  32. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  33. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  34. def flowURL(): String

    Permalink
  35. def getAndVerifyWorkerNodes(conf: H2OConf): Array[NodeDesc]

    Permalink
    Attributes
    protected
    Definition Classes
    H2OContextExtensions
  36. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  37. def getClusterEndpoint(conf: H2OConf): URI

    Permalink
    Definition Classes
    RestApiUtils
  38. def getClusterInfo(conf: H2OConf): CloudV3

    Permalink
    Definition Classes
    RestApiUtils
  39. def getConf: H2OConf

    Permalink

    Return a copy of this H2OContext's configuration.

    Return a copy of this H2OContext's configuration. The configuration cannot be changed at runtime.

  40. def getH2OLogLevel(): String

    Permalink
  41. def getH2ONodes(): Array[NodeDesc]

    Permalink
  42. def getLogLevel(conf: H2OConf): String

    Permalink
    Definition Classes
    RestApiUtils
  43. def getNodes(cloudV3: CloudV3): Array[NodeDesc]

    Permalink
    Definition Classes
    RestApiUtils
  44. def getNodes(conf: H2OConf): Array[NodeDesc]

    Permalink
    Definition Classes
    RestApiUtils
  45. def getPingInfo(conf: H2OConf): PingV3

    Permalink
    Definition Classes
    RestApiUtils
  46. def getTimeZone(conf: H2OConf): String

    Permalink
    Definition Classes
    RestApiUtils
  47. def h2oLocalClient: String

    Permalink

    Returns location of REST API of H2O client

  48. def h2oLocalClientIp: String

    Permalink

    Returns IP of H2O client

  49. def h2oLocalClientPort: Int

    Permalink

    Returns port where H2O REST API is exposed

  50. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  51. object implicits extends H2OContextImplicits with Serializable

    Permalink

    Define implicits available via h2oContext.implicits._

  52. def importHiveTable(database: String = HiveTableImporter.DEFAULT_DATABASE, table: String, partitions: Array[Array[String]] = null, allowMultiFormat: Boolean = false): H2OFrame

    Permalink
    Definition Classes
    H2OContextExtensions
  53. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  54. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  55. def insert(endpoint: URI, suffix: String, conf: H2OConf, streamWrapper: (OutputStream) ⇒ OutputStream = identity, params: Map[String, Any] = Map.empty): OutputStream

    Permalink

    endpoint

    An address of H2O node with exposed REST endpoint

    suffix

    REST relative path representing a specific call

    conf

    H2O conf object

    params

    Query parameters

    returns

    HttpUrlConnection facilitating the insertion and holding the outputStream

    Attributes
    protected
    Definition Classes
    RestCommunication
  56. def insertToNode(node: NodeDesc, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty): OutputStream

    Permalink

    node

    H2O node descriptor

    suffix

    REST relative path representing a specific call

    conf

    H2O conf object

    params

    Query parameters

    returns

    HttpUrlConnection facilitating the insertion and holding the outputStream

    Definition Classes
    RestCommunication
  57. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  58. def isPrimitiveType(value: Any): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    RestEncodingUtils
  59. def isStopped(): Boolean

    Permalink
  60. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  61. def launchShellCommand(cmdToLaunch: Seq[String]): Int

    Permalink
    Attributes
    protected
    Definition Classes
    ShellUtils
  62. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  63. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  64. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  65. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  66. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  67. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  68. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  69. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  70. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  71. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  72. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  73. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  74. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  75. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  76. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  77. def openFlow(): Unit

    Permalink

    Open H2O Flow running in this client.

  78. def openURI(uri: String): Unit

    Permalink

    Open browser for given address.

    Open browser for given address.

    uri

    address to open in browser, e.g., http://example.com

    Attributes
    protected
    Definition Classes
    H2OContextExtensions
  79. def query[ResultType](endpoint: URI, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty, skippedFields: Seq[(Class[_], String)] = Seq.empty, confirmationLoggingLevel: LoggingLevel = Info)(implicit arg0: ClassTag[ResultType]): ResultType

    Permalink

    ResultType

    A type that the result will be deserialized to

    endpoint

    An address of H2O node with exposed REST endpoint

    suffix

    REST relative path representing a specific call

    conf

    H2O conf object

    params

    Query parameters

    skippedFields

    The list of field specifications that are skipped during deserialization. The specification consists of the class containing the field and the field name.

    returns

    A deserialized object

    Definition Classes
    RestCommunication
  80. def readURLContent(endpoint: URI, requestType: String, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty, encodeParamsAsJson: Boolean = false, file: Option[String] = None, confirmationLoggingLevel: LoggingLevel = Info): InputStream

    Permalink
    Attributes
    protected
    Definition Classes
    RestCommunication
  81. def request[ResultType](endpoint: URI, requestType: String, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty, skippedFields: Seq[(Class[_], String)] = Seq.empty, encodeParamsAsJson: Boolean = false, confirmationLoggingLevel: LoggingLevel = Info)(implicit arg0: ClassTag[ResultType]): ResultType

    Permalink
    Definition Classes
    RestCommunication
  82. def resolveNodeEndpoint(node: NodeDesc, conf: H2OConf): URI

    Permalink
    Definition Classes
    RestApiUtils
  83. def setH2OLogLevel(level: String): Unit

    Permalink
  84. def setLogLevel(conf: H2OConf, logLevel: String): Unit

    Permalink
    Definition Classes
    RestApiUtils
  85. def setTimeZone(conf: H2OConf, timezone: String): Unit

    Permalink
    Definition Classes
    RestApiUtils
  86. def shutdownCluster(conf: H2OConf): Unit

    Permalink
    Definition Classes
    RestApiUtils
  87. val sparkContext: SparkContext

    Permalink
  88. def stop(stopSparkContext: Boolean = false): Unit

    Permalink

    Stops H2O context.

    Stops H2O context.

    stopSparkContext

    stop also spark context

  89. def stringify(value: Any): String

    Permalink
    Attributes
    protected
    Definition Classes
    RestEncodingUtils
  90. def stringifyArray(arr: Array[_]): String

    Permalink
    Attributes
    protected
    Definition Classes
    RestEncodingUtils
  91. def stringifyMap(map: Map[_, _]): String

    Permalink
    Attributes
    protected
    Definition Classes
    RestEncodingUtils
  92. def stringifyPair(pair: Tuple2[_, _]): String

    Permalink
    Attributes
    protected
    Definition Classes
    RestEncodingUtils
  93. def stringifyParams(params: Map[String, Any] = Map.empty, encodeParamsAsJson: Boolean = false): String

    Permalink
    Attributes
    protected
    Definition Classes
    RestEncodingUtils
  94. def stringifyPrimitiveParam(value: Any): String

    Permalink
    Attributes
    protected
    Definition Classes
    RestEncodingUtils
  95. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  96. def toString(): String

    Permalink
    Definition Classes
    H2OContext → AnyRef → Any
  97. def update[ResultType](endpoint: URI, suffix: String, conf: H2OConf, params: Map[String, Any] = Map.empty, skippedFields: Seq[(Class[_], String)] = Seq.empty, encodeParamsAsJson: Boolean = false)(implicit arg0: ClassTag[ResultType]): ResultType

    Permalink

    ResultType

    A type that the result will be deserialized to

    endpoint

    An address of H2O node with exposed REST endpoint

    suffix

    REST relative path representing a specific call

    conf

    H2O conf object

    params

    Query parameters

    skippedFields

    The list of field specifications that are skipped during deserialization. The specification consists of the class containing the field and the field name.

    returns

    A deserialized object

    Definition Classes
    RestCommunication
  98. def visibleFlowURL(): String

    Permalink
  99. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  100. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  101. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  102. def withConversionDebugPrints(sc: SparkContext, conversionName: String, block: ⇒ H2OFrame): H2OFrame

    Permalink
    Attributes
    protected
    Definition Classes
    H2OContextExtensions

Inherited from H2OContextExtensions

Inherited from ShellUtils

Inherited from RestApiUtils

Inherited from RestCommunication

Inherited from RestEncodingUtils

Inherited from Logging

Inherited from Serializable

Inherited from Serializable

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Ungrouped