hex.glm

Class GLMTask.DataAddW2AugXZ

java.lang.Object

jsr166y.ForkJoinTask<java.lang.Void>

jsr166y.CountedCompleter

water.H2O.H2OCountedCompleter<T>

water.DTask<T>

water.MRTask<GLMTask.DataAddW2AugXZ>

hex.glm.GLMTask.DataAddW2AugXZ

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.util.concurrent.Future<java.lang.Void>, jsr166y.ForkJoinPool.ManagedBlocker, water.Freezable<GLMTask.DataAddW2AugXZ>

Enclosing class:

GLMTask

public static class GLMTask.DataAddW2AugXZ
extends water.MRTask<GLMTask.DataAddW2AugXZ>

This class will update the frame AugXZ which contains Ta*sqrt(W inverse) from documentation: - multiply the generated weight value to Ta and store in AugXZ;

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class water.MRTask

water.MRTask.PostMapAction<T extends water.MRTask.PostMapAction<T>>

Nested classes/interfaces inherited from class water.DTask

water.DTask.DKeyTask<T extends water.DTask.DKeyTask,V extends water.Keyed>, water.DTask.RemoveCall

Field Summary

Fields

Modifier and Type	Field and Description
int	_dataColNumber
long	_dataRows
DataInfo	_dinfo
int	_numColStart
int	_numRandCol
int[]	_randCatLevels
int	_wdataID

Fields inherited from class water.MRTask

_appendables, _fr, _fs, _hi, _keys, _left, _lo, _nhi, _nleft, _nlo, _nrite, _rite, _run_local, _topLocal

Fields inherited from class water.DTask

_ex

Constructor Summary

Constructors

Constructor and Description
DataAddW2AugXZ(water.Job job, DataInfo dInfo, int[] randCatLevels)

Method Summary

Modifier and Type	Method and Description
static void	getAllChunks(water.fvec.Frame augXZ, int chkIdx, water.fvec.Chunk[] chks, int[] vecIdx) Given the chkIdx, this method will fetch the chunks with columns specified in vecIdx
static int[]	getCorrectChunk(water.fvec.Frame augXZ, int chkIdx, long currentRowAbs, water.fvec.Chunk[] chks, int[] vecIdx, int[] returnInfo) This method, given the absolute row index of interest, will grab the correct chunk from augXZ containing the same absolute row index of interest.
static int	getOneSingleChunk(water.fvec.Frame augXZ, int chkIdx, long currentRowAbs, water.fvec.Chunk[] chks, int[] vecIdx) Given the absolute row index of interest, this method will find the chunk index of augXZ that contains the absolute row index
void	map(water.fvec.Chunk[] chunks)

Methods inherited from class water.MRTask

appendables, asyncExecOnAllNodes, block, closeLocal, compute2, dfork, dfork, dfork, dfork, dfork, dinvoke, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAll, doAllNodes, getResult, getResult, isReleasable, map, map, map, map, map, map, map, map, map, map, map, modifiesVolatileVecs, onCompletion, onExceptionalCompletion, outputFrame, outputFrame, outputFrame, postGlobal, profile, profString, reduce, self, setupLocal, withPostMapAction

Methods inherited from class water.DTask

copyOver, getDException, hasException, logVerbose, onAck, onAckAck, setException

Methods inherited from class water.H2O.H2OCountedCompleter

asBytes, clone, compute, compute1, currThrPriority, frozenType, icer, priority, read, readJSON, reloadFromBytes, write, writeJSON

Methods inherited from class jsr166y.CountedCompleter

__tryComplete, addToPendingCount, compareAndSetPendingCount, complete, exec, getCompleter, getPendingCount, getRawResult, setCompleter, setPendingCount, setRawResult, tryComplete

Methods inherited from class jsr166y.ForkJoinTask

adapt, adapt, adapt, cancel, compareAndSetForkJoinTaskTag, completeExceptionally, fork, get, get, get, getException, getForkJoinTaskTag, getPool, getQueuedTaskCount, getSurplusQueuedTaskCount, helpQuiesce, inForkJoinPool, invoke, invokeAll, invokeAll, invokeAll, isCancelled, isCompletedAbnormally, isCompletedNormally, isDone, join, peekNextLocalTask, pollNextLocalTask, pollTask, quietlyComplete, quietlyInvoke, quietlyJoin, reinitialize, setForkJoinTaskTag, tryUnfork

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

_dinfo

public DataInfo _dinfo

_wdataID

public int _wdataID

_randCatLevels

public int[] _randCatLevels

_dataColNumber

public int _dataColNumber

_numColStart

public int _numColStart

_numRandCol

public int _numRandCol

_dataRows

public long _dataRows

Constructor Detail

DataAddW2AugXZ

public DataAddW2AugXZ(water.Job job,
                      DataInfo dInfo,
                      int[] randCatLevels)

Method Detail

map

public void map(water.fvec.Chunk[] chunks)

Overrides:

map in class water.MRTask<GLMTask.DataAddW2AugXZ>

getAllChunks

public static void getAllChunks(water.fvec.Frame augXZ,
                                int chkIdx,
                                water.fvec.Chunk[] chks,
                                int[] vecIdx)

Given the chkIdx, this method will fetch the chunks with columns specified in vecIdx

Parameters:

augXZ: - Frame frome which chunks are fetched

chkIdx: - chunk index to fetch

chks: - store fetched chunks

vecIdx: - null, fetch all columns, else, contains columns of interest to fetch

getOneSingleChunk

public static int getOneSingleChunk(water.fvec.Frame augXZ,
                                    int chkIdx,
                                    long currentRowAbs,
                                    water.fvec.Chunk[] chks,
                                    int[] vecIdx)

Given the absolute row index of interest, this method will find the chunk index of augXZ that contains the absolute row index

Parameters:

augXZ: - Frame where chunks will be fetched

chkIdx: - chunk index to check if it contains the absolute row index of interest

currentRowAbs: - absolute row index of interest

chks: - chunks to stored fetched chunk

vecIdx: - column indices to fetch. If null, fetch all columns

Returns:

getCorrectChunk

public static int[] getCorrectChunk(water.fvec.Frame augXZ,
                                    int chkIdx,
                                    long currentRowAbs,
                                    water.fvec.Chunk[] chks,
                                    int[] vecIdx,
                                    int[] returnInfo)

This method, given the absolute row index of interest, will grab the correct chunk from augXZ containing the same absolute row index of interest. The chunks of augXZ will be stored in chks. In addition, an integer array will be returned that contain the following information about the fetched chunk of augXZ: - index 0: chunk index; - index 1: number of rows of fetched chunk; - index 2: relative starting index of fetched chunk that will correspond to the absolute row index of interest passed to this method.

Parameters:

augXZ: - Frame from which chunks will be grabbed

chkIdx: - starting chunk index to looking at

currentRowAbs: - absolute row index of first row of interest

chks: - stored fetched chunk

vecIdx: - null if all columns should be fetched. Else, contains the columns to be fetched

returnInfo: - information about fetched chunk

Returns: