water.fvec

Class TransformWrappedVec

java.lang.Object

water.Iced<T>

water.Keyed<Vec>

water.fvec.Vec

water.fvec.TransformWrappedVec

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, java.lang.Cloneable, Freezable<Vec>

public class TransformWrappedVec
extends Vec

This wrapper pushes a transform down into each chunk so that transformations will happen on-the-fly. When wrapped and there are Op instances to be applied, the atd call will supersede the usual chunk-at retrieval with a "special" atd call. Overhead added per element fetch per chunk is another virtual call per Op per element (per Chunk). As has been noted (see e.g. RollupStats), virtual calls are expensive, but the memory savings are substantial. AutoML can freely transform columns without ramification. Each wrapped Vec will track its own transformations, which makes it easy when generating a POJO. A TransformWrappedVec is actually a function of one or more Vec instances. This class exists here so that Chunk and NewChunk don't need to become fully public (since java has no friends). Other packages (not just core H2O) depend on this class!

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TransformWrappedVec.Function1DTransform
static interface	TransformWrappedVec.Transform
static interface	TransformWrappedVec.TransformFactory<T extends Freezable>
static class	TransformWrappedVec.TransformWrappedChunk

Nested classes/interfaces inherited from class water.fvec.Vec

Vec.ESPC, Vec.Holder, Vec.Reader, Vec.VectorGroup, Vec.Writer

Field Summary

Fields inherited from class water.fvec.Vec

_cids, _rowLayout, DO_HISTOGRAMS, KEY_PREFIX_LEN, PERCENTILES, T_BAD, T_CAT, T_NUM, T_STR, T_TIME, T_UUID, TYPE_STR

Fields inherited from class water.Keyed

_key

Constructor Summary

Constructors

Constructor and Description
TransformWrappedVec(Key<Vec> key, int rowLayout, AstPrimitive fun, Key<Vec>[] masterVecKeys)
TransformWrappedVec(Key<Vec> key, int rowLayout, TransformWrappedVec.TransformFactory<?> fact, Key<Vec>[] masterVecKeys)
TransformWrappedVec(Vec[] vecs, TransformWrappedVec.TransformFactory<?> fact)
TransformWrappedVec(Vec v, AstPrimitive fun)

Method Summary

Modifier and Type	Method and Description
Chunk	chunkForChunkIdx(int cidx) Map from chunk-index to Chunk.
Vec	doCopy()
Vec	makeVec()
Vec	masterVec()

Methods inherited from class water.fvec.Vec

adaptTo, align, asDouble, at, at16h, at16l, at8, atStr, base, bins, bulk_remove, byteSize, cardinality, checksum_impl, chunkForRow, chunkKey, chunkKey, chunkLen, domain, elem2ChunkIdx, equals, espc, factor, get_type_str, get_type, getVecKey, group, hashCode, isBad, isBinary, isBinary, isBinaryOnes, isCategorical, isCompatibleWith, isConst, isConst, isDomainTruncated, isHomedLocally, isInt, isNA, isNumeric, isString, isTime, isUUID, isVolatile, lazy_bins, length, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeConN, makeCons, makeCons, makeCopy, makeCopy, makeCopy, makeDoubles, makeOne, makeOne, makeOnes, makeOnes, makeRand, makeRepSeq, makeSeq, makeSeq, makeSeq, makeTimeVec, makeVec, makeVec, makeVec, makeVec, makeVec, makeVec, makeVolatileDoubles, makeVolatileInts, makeZero, makeZero, makeZero, makeZero, makeZero, makeZeros, makeZeros, max, maxs, mean, min, mins, mode, naCnt, nChunks, nChunksFor, newKey, ninfs, nonEmptyChunks, nzCnt, open, pctiles, pinfs, postWrite, preWriting, readAll_impl, remove_impl, remove_self_key_impl, rollupStatsKey, set, set, set, set, set, setBad, setChunkIdx, setDomain, setNA, sigma, sparseRatio, startRollupStats, startRollupStats, stride, stringAt, toCategoricalVec, toIntegerVec, toNumericVec, toString, toStringVec, toTwoDimTable, toTwoDimTable, writeAll_impl

Methods inherited from class water.Keyed

checksum_impl, checksum, checksum, getKey, makeSchema, readAll, remove_impl, remove, remove, remove, remove, remove, remove, removeQuietly, writeAll

Methods inherited from class water.Iced

asBytes, clone, copyOver, frozenType, read, readExternal, readJSON, reloadFromBytes, toJsonBytes, toJsonString, write, writeExternal, writeJSON

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

TransformWrappedVec

public TransformWrappedVec(Key<Vec> key,
                           int rowLayout,
                           TransformWrappedVec.TransformFactory<?> fact,
                           Key<Vec>[] masterVecKeys)

TransformWrappedVec

public TransformWrappedVec(Vec v,
                           AstPrimitive fun)

TransformWrappedVec

public TransformWrappedVec(Vec[] vecs,
                           TransformWrappedVec.TransformFactory<?> fact)

TransformWrappedVec

public TransformWrappedVec(Key<Vec> key,
                           int rowLayout,
                           AstPrimitive fun,
                           Key<Vec>[] masterVecKeys)

Method Detail

makeVec

public Vec makeVec()

chunkForChunkIdx

public Chunk chunkForChunkIdx(int cidx)

Map from chunk-index to Chunk. These wrappers are making custom Chunks

Returns:

Chunk for a chunk#

doCopy

public Vec doCopy()

Overrides:

doCopy in class Vec

masterVec

public Vec masterVec()