water.fvec

Class CategoricalWrappedVec

java.lang.Object

water.Iced<T>

water.Keyed<Vec>

water.fvec.Vec

water.fvec.CategoricalWrappedVec

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, java.lang.Cloneable, Freezable<Vec>

public class CategoricalWrappedVec
extends Vec

A vector transforming values of given vector according to given domain mapping - currently only used to transform categorical columns but in theory would work for any dense-packed Int column. Expected usage is to map from a new dataset to the domain-mapping expected by a model (which will match the dataset it was trained on).

The Vector's domain is the union of the Test and Train domains.

The mapping is defined by int[] array, size is input Test.domain.length. Contents refer to values in the Train.domain. Extra values in the Test domain are sorted after the Train.domain - so mapped values have to be range-checked (note that returning some flag for NA, say -1, would also need to be checked for).

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CategoricalWrappedVec.CategoricalWrappedChunk

Nested classes/interfaces inherited from class water.fvec.Vec

Vec.ESPC, Vec.Holder, Vec.Reader, Vec.VectorGroup, Vec.Writer

Field Summary

Fields inherited from class water.fvec.Vec

_cids, _rowLayout, DO_HISTOGRAMS, KEY_PREFIX_LEN, PERCENTILES, T_BAD, T_CAT, T_NUM, T_STR, T_TIME, T_UUID, TYPE_STR

Fields inherited from class water.Keyed

_key

Constructor Summary

Constructors

Constructor and Description
CategoricalWrappedVec(Key key, int rowLayout, java.lang.String[] toDomain, Key masterVecKey) Main constructor: convert from one categorical to another

Method Summary

Modifier and Type	Method and Description
Chunk	chunkForChunkIdx(int cidx) Map from chunk-index to Chunk.
static int[]	computeMap(java.lang.String[] from, java.lang.String[] to)
Vec	doCopy()
Vec	masterVec()
static Vec	updateDomain(Vec source, java.lang.String[] toDomain) Updates Vec's domain in-place (instead of creating a wrapper Vec)

Methods inherited from class water.fvec.Vec

adaptTo, align, asDouble, at, at16h, at16l, at8, atStr, base, bins, bulk_remove, byteSize, cardinality, checksum_impl, chunkForRow, chunkKey, chunkKey, chunkLen, domain, elem2ChunkIdx, equals, espc, factor, get_type_str, get_type, getVecKey, group, hashCode, isBad, isBinary, isBinary, isBinaryOnes, isCategorical, isCompatibleWith, isConst, isConst, isDomainTruncated, isHomedLocally, isInt, isNA, isNumeric, isString, isTime, isUUID, isVolatile, lazy_bins, length, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeConN, makeCons, makeCons, makeCopy, makeCopy, makeCopy, makeDoubles, makeOne, makeOne, makeOnes, makeOnes, makeRand, makeRepSeq, makeSeq, makeSeq, makeSeq, makeTimeVec, makeVec, makeVec, makeVec, makeVec, makeVec, makeVec, makeVolatileDoubles, makeVolatileInts, makeZero, makeZero, makeZero, makeZero, makeZero, makeZeros, makeZeros, max, maxs, mean, min, mins, mode, naCnt, nChunks, nChunksFor, newKey, ninfs, nonEmptyChunks, nzCnt, open, pctiles, pinfs, postWrite, preWriting, readAll_impl, remove_impl, remove_self_key_impl, rollupStatsKey, set, set, set, set, set, setBad, setChunkIdx, setDomain, setNA, sigma, sparseRatio, startRollupStats, startRollupStats, stride, stringAt, toCategoricalVec, toIntegerVec, toNumericVec, toString, toStringVec, toTwoDimTable, toTwoDimTable, writeAll_impl

Methods inherited from class water.Keyed

checksum_impl, checksum, checksum, getKey, makeSchema, readAll, remove_impl, remove, remove, remove, remove, remove, remove, removeQuietly, writeAll

Methods inherited from class water.Iced

asBytes, clone, copyOver, frozenType, read, readExternal, readJSON, reloadFromBytes, toJsonBytes, toJsonString, write, writeExternal, writeJSON

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

CategoricalWrappedVec

public CategoricalWrappedVec(Key key,
                             int rowLayout,
                             java.lang.String[] toDomain,
                             Key masterVecKey)

Main constructor: convert from one categorical to another

Method Detail

computeMap

public static int[] computeMap(java.lang.String[] from,
                               java.lang.String[] to)

updateDomain

public static Vec updateDomain(Vec source,
                               java.lang.String[] toDomain)

Updates Vec's domain in-place (instead of creating a wrapper Vec)

Parameters:

source - source Vec

toDomain - target domain

Returns:

updated instance of Vec

chunkForChunkIdx

public Chunk chunkForChunkIdx(int cidx)

Map from chunk-index to Chunk. These wrappers are making custom Chunks

Returns:

Chunk for a chunk#

doCopy

public Vec doCopy()

Overrides:

doCopy in class Vec

masterVec

public Vec masterVec()