water.fvec

Class Vec.VectorGroup

java.lang.Object

water.Iced<T>

water.Keyed<Vec.VectorGroup>

water.fvec.Vec.VectorGroup

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, java.lang.Cloneable, Freezable<Vec.VectorGroup>

Enclosing class:

Vec

public static class Vec.VectorGroup
extends Keyed<Vec.VectorGroup>

Class representing the group of vectors. Vectors from the same group have same distribution of chunks among nodes. Each vector is member of exactly one group. Default group of one vector is created for each vector. Group of each vector can be retrieved by calling group() method; The expected mode of operation is that user wants to add new vectors matching the source. E.g. parse creates several vectors (one for each column) which are all colocated and are colocated with the original bytevector. To do this, user should first ask for the set of keys for the new vectors by calling addVecs method on the target group. Vectors in the group will have the same keys except for the prefix which specifies index of the vector inside the group. The only information the group object carries is its own key and the number of vectors it contains (deleted vectors still count). Because vectors (and chunks) share the same key-pattern with the group, default group with only one vector does not have to be actually created, it is implicit.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static Vec.VectorGroup	VG_LEN1 The common shared vector group for very short vectors

Fields inherited from class water.Keyed

_key

Constructor Summary

Constructors

Constructor and Description
VectorGroup()

Method Summary

Modifier and Type	Method and Description
Key<Vec>	addVec() Shortcut for addVecs(1).
Key<Vec>[]	addVecs(int n) Gets the next n keys of this group.
protected long	checksum_impl() High-quality 64-bit checksum of the content of the object.
boolean	equals(java.lang.Object o) True if two VectorGroups are equal
int	hashCode() VectorGroups's hashcode
int	len()
protected Keyed	readAll_impl(AutoBuffer ab, Futures fs)
protected Futures	remove_impl(Futures fs, boolean cascade) Override to remove subparts, but not self, of composite Keyed objects.
int	reserveKeys(int n) Reserve a range of keys and return index of first new available key
java.lang.String	toString() Pretty print the VectorGroup
Key<Vec>	vecKey(int vecId) Returns Vec Key from Vec id#.
protected AutoBuffer	writeAll_impl(AutoBuffer ab) Write out K/V pairs

Methods inherited from class water.Keyed

checksum_impl, checksum, checksum, getKey, makeSchema, readAll, remove_impl, remove_self_key_impl, remove, remove, remove, remove, remove, remove, removeQuietly, writeAll

Methods inherited from class water.Iced

asBytes, clone, copyOver, frozenType, read, readExternal, readJSON, reloadFromBytes, toJsonBytes, toJsonString, write, writeExternal, writeJSON

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

VG_LEN1

public static final Vec.VectorGroup VG_LEN1

The common shared vector group for very short vectors

Constructor Detail

VectorGroup

public VectorGroup()

Method Detail

vecKey

public Key<Vec> vecKey(int vecId)

Returns Vec Key from Vec id#. Does NOT allocate a Key id#

Returns:

Vec Key from Vec id#

reserveKeys

public int reserveKeys(int n)

Reserve a range of keys and return index of first new available key

Returns:

Vec id# of a range of Vec keys in this group

addVecs

public Key<Vec>[] addVecs(int n)

Gets the next n keys of this group.

Parameters:

n - number of keys to make

Returns:

arrays of unique keys belonging to this group.

addVec

public Key<Vec> addVec()

Shortcut for addVecs(1).

Returns:

a new Vec Key in this group

See Also:

addVecs(int)

toString

public java.lang.String toString()

Pretty print the VectorGroup

Overrides:

toString in class java.lang.Object

Returns:

String representation of a VectorGroup

len

public int len()

equals

public boolean equals(java.lang.Object o)

True if two VectorGroups are equal

Overrides:

equals in class java.lang.Object

Returns:

True if two VectorGroups are equal

hashCode

public int hashCode()

VectorGroups's hashcode

Overrides:

hashCode in class java.lang.Object

Returns:

VectorGroups's hashcode

checksum_impl

protected long checksum_impl()

Description copied from class: Keyed

High-quality 64-bit checksum of the content of the object. Similar to hashcode(), but a long to reduce the chance of hash clashes. For composite objects this should be defined using the subcomponents' checksums (or hashcodes if not available). If two Keyed objects have the same checksum() there should be a 1 - 1/2^64 chance that they are the same object by value.

Overrides:

checksum_impl in class Keyed<Vec.VectorGroup>

remove_impl

protected Futures remove_impl(Futures fs,
                              boolean cascade)

Description copied from class: Keyed

Override to remove subparts, but not self, of composite Keyed objects. Examples include Vec (removing associated Chunk keys) and Frame (removing associated Vec keys.)

Overrides:

remove_impl in class Keyed<Vec.VectorGroup>

writeAll_impl

protected AutoBuffer writeAll_impl(AutoBuffer ab)

Write out K/V pairs

Overrides:

writeAll_impl in class Keyed<Vec.VectorGroup>

readAll_impl

protected Keyed readAll_impl(AutoBuffer ab,
                             Futures fs)

Overrides:

readAll_impl in class Keyed<Vec.VectorGroup>