hex

Class ContributionsWithBackgroundFrameTask<T extends ContributionsWithBackgroundFrameTask<T>>

java.lang.Object

jsr166y.ForkJoinTask<java.lang.Void>

jsr166y.CountedCompleter

water.H2O.H2OCountedCompleter<T>

water.DTask<T>

water.MRTask<T>

hex.ContributionsWithBackgroundFrameTask<T>

Type Parameters:

T -

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.util.concurrent.Future<java.lang.Void>, jsr166y.ForkJoinPool.ManagedBlocker, water.Freezable<T>

Direct Known Subclasses:

SharedTreeModelWithContributions.ScoreContributionsWithBackgroundTask

public abstract class ContributionsWithBackgroundFrameTask<T extends ContributionsWithBackgroundFrameTask<T>>
extends water.MRTask<T>

Calls map(Chunk[] frame, Chunk[] background, NewChunk[] ncs) by copying the smaller frame across the nodes.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class water.MRTask

water.MRTask.PostMapAction<T extends water.MRTask.PostMapAction<T>>

Nested classes/interfaces inherited from class water.DTask

water.DTask.DKeyTask<T extends water.DTask.DKeyTask,V extends water.Keyed>, water.DTask.RemoveCall

Field Summary

Fields inherited from class water.MRTask

_appendables, _fr, _fs, _hi, _keys, _left, _lo, _nhi, _nleft, _nlo, _nrite, _rite, _run_local, _topLocal

Fields inherited from class water.DTask

_ex

Constructor Summary

Constructors

Constructor and Description
ContributionsWithBackgroundFrameTask(water.Key<water.fvec.Frame> frKey, water.Key<water.fvec.Frame> backgroundFrameKey, boolean perReference)

Method Summary

Modifier and Type	Method and Description
static boolean	enoughMinMemory(double estimatedMemory)
static double	estimatePerNodeMinimalMemory(int nCols, water.fvec.Frame frame, water.fvec.Frame backgroundFrame)
static double	estimateRequiredMemory(int nCols, water.fvec.Frame frame, water.fvec.Frame backgroundFrame)
protected void	loadFrames()
protected abstract void	map(water.fvec.Chunk[] cs, water.fvec.Chunk[] bgCs, water.fvec.NewChunk[] ncs)
void	map(water.fvec.Chunk[] cs, water.fvec.NewChunk[] ncs)
static long	minMemoryPerNode()
water.fvec.Frame	runAndGetOutput(water.Job j, water.Key<water.fvec.Frame> destinationKey, java.lang.String[] names)
static long	totalFreeMemory()

Methods inherited from class water.MRTask

appendables, asyncExecOnAllNodes, block, closeLocal, compute2, dfork, dfork, dfork, dfork, dfork, dinvoke, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAllNodes, getResult, getResult, isReleasable, map, map, map, map, map, map, map, map, map, map, map, modifiesVolatileVecs, onCompletion, onExceptionalCompletion, outputFrame, outputFrame, outputFrame, postGlobal, profile, profString, reduce, self, setupLocal, withPostMapAction

Methods inherited from class water.DTask

copyOver, getDException, hasException, logVerbose, onAck, onAckAck, setException

Methods inherited from class water.H2O.H2OCountedCompleter

asBytes, clone, compute, compute1, currThrPriority, frozenType, icer, priority, read, readJSON, reloadFromBytes, write, writeJSON

Methods inherited from class jsr166y.CountedCompleter

__tryComplete, addToPendingCount, compareAndSetPendingCount, complete, exec, getCompleter, getPendingCount, getRawResult, setCompleter, setPendingCount, setRawResult, tryComplete

Methods inherited from class jsr166y.ForkJoinTask

adapt, adapt, adapt, cancel, compareAndSetForkJoinTaskTag, completeExceptionally, fork, get, get, get, getException, getForkJoinTaskTag, getPool, getQueuedTaskCount, getSurplusQueuedTaskCount, helpQuiesce, inForkJoinPool, invoke, invokeAll, invokeAll, invokeAll, isCancelled, isCompletedAbnormally, isCompletedNormally, isDone, join, peekNextLocalTask, pollNextLocalTask, pollTask, quietlyComplete, quietlyInvoke, quietlyJoin, reinitialize, setForkJoinTaskTag, tryUnfork

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ContributionsWithBackgroundFrameTask

public ContributionsWithBackgroundFrameTask(water.Key<water.fvec.Frame> frKey,
                                            water.Key<water.fvec.Frame> backgroundFrameKey,
                                            boolean perReference)

Method Detail

loadFrames

protected void loadFrames()

map

public void map(water.fvec.Chunk[] cs,
                water.fvec.NewChunk[] ncs)

Overrides:

map in class water.MRTask<T extends ContributionsWithBackgroundFrameTask<T>>

estimateRequiredMemory

public static double estimateRequiredMemory(int nCols,
                                            water.fvec.Frame frame,
                                            water.fvec.Frame backgroundFrame)

estimatePerNodeMinimalMemory

public static double estimatePerNodeMinimalMemory(int nCols,
                                                  water.fvec.Frame frame,
                                                  water.fvec.Frame backgroundFrame)

minMemoryPerNode

public static long minMemoryPerNode()

totalFreeMemory

public static long totalFreeMemory()

enoughMinMemory

public static boolean enoughMinMemory(double estimatedMemory)

map

protected abstract void map(water.fvec.Chunk[] cs,
                            water.fvec.Chunk[] bgCs,
                            water.fvec.NewChunk[] ncs)

runAndGetOutput

public water.fvec.Frame runAndGetOutput(water.Job j,
                                        water.Key<water.fvec.Frame> destinationKey,
                                        java.lang.String[] names)