water.fvec

Class UploadFileVec

java.lang.Object

water.Iced<T>

water.Keyed<Vec>

water.fvec.Vec

water.fvec.ByteVec

water.fvec.FileVec

water.fvec.UploadFileVec

All Implemented Interfaces:

java.io.Externalizable, java.io.Serializable, java.lang.Cloneable, Freezable<Vec>

public class UploadFileVec
extends FileVec

Build a Vec by reading from an InputStream

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	UploadFileVec.ReadPutStats

Nested classes/interfaces inherited from class water.fvec.Vec

Vec.ESPC, Vec.Holder, Vec.Reader, Vec.VectorGroup, Vec.Writer

Field Summary

Fields inherited from class water.fvec.FileVec

_chunkSize, _nChunks, DFLT_CHUNK_SIZE, DFLT_LOG2_CHUNK_SIZE

Fields inherited from class water.fvec.Vec

_cids, _rowLayout, DO_HISTOGRAMS, KEY_PREFIX_LEN, PERCENTILES, T_BAD, T_CAT, T_NUM, T_STR, T_TIME, T_UUID, TYPE_STR

Fields inherited from class water.Keyed

_key

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	UploadFileVec(Key key)

Method Summary

Modifier and Type	Method and Description
void	addAndCloseChunk(Chunk c, Futures fs)
Value	chunkIdx(int cidx) Get a Chunk's Value by index.
void	close(water.fvec.C1NChunk c, int cidx, Futures fs)
static Key	readPut(Key k, java.io.InputStream is, UploadFileVec.ReadPutStats stats)
static Key	readPut(java.lang.String keyname, java.io.InputStream is, UploadFileVec.ReadPutStats stats)
int	setChunkSize(Frame fr, int chunkSize)
boolean	writable() Default read/write behavior for Vecs.

Methods inherited from class water.fvec.FileVec

byteSize, calcOptimalChunkSize, chunkOffset, elem2ChunkIdx, getBackend, getPath, getPathForKey, length, nChunks, nonEmptyChunks, setChunkSize, setNChunks

Methods inherited from class water.fvec.ByteVec

chunkForChunkIdx, getFirstBytes, isInt, naCnt, openStream, openStream

Methods inherited from class water.fvec.Vec

adaptTo, align, asDouble, at, at16h, at16l, at8, atStr, base, bins, bulk_remove, cardinality, checksum_impl, chunkForRow, chunkKey, chunkKey, chunkLen, doCopy, domain, equals, espc, factor, get_type_str, get_type, getVecKey, group, hashCode, isBad, isBinary, isBinary, isBinaryOnes, isCategorical, isCompatibleWith, isConst, isConst, isDomainTruncated, isHomedLocally, isNA, isNumeric, isString, isTime, isUUID, isVolatile, lazy_bins, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeCon, makeConN, makeCons, makeCons, makeCopy, makeCopy, makeCopy, makeDoubles, makeOne, makeOne, makeOnes, makeOnes, makeRand, makeRepSeq, makeSeq, makeSeq, makeSeq, makeTimeVec, makeVec, makeVec, makeVec, makeVec, makeVec, makeVec, makeVolatileDoubles, makeVolatileInts, makeZero, makeZero, makeZero, makeZero, makeZero, makeZeros, makeZeros, max, maxs, mean, min, mins, mode, nChunksFor, newKey, ninfs, nzCnt, open, pctiles, pinfs, postWrite, preWriting, readAll_impl, remove_impl, remove_self_key_impl, rollupStatsKey, set, set, set, set, set, setBad, setChunkIdx, setDomain, setNA, sigma, sparseRatio, startRollupStats, startRollupStats, stride, stringAt, toCategoricalVec, toIntegerVec, toNumericVec, toString, toStringVec, toTwoDimTable, toTwoDimTable, writeAll_impl

Methods inherited from class water.Keyed

checksum_impl, checksum, checksum, getKey, makeSchema, readAll, remove_impl, remove, remove, remove, remove, remove, remove, removeQuietly, writeAll

Methods inherited from class water.Iced

asBytes, clone, copyOver, frozenType, read, readExternal, readJSON, reloadFromBytes, toJsonBytes, toJsonString, write, writeExternal, writeJSON

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

UploadFileVec

protected UploadFileVec(Key key)

Method Detail

writable

public boolean writable()

Description copied from class: Vec

Default read/write behavior for Vecs. AppendableVecs are write-only.

Overrides:

writable in class FileVec

addAndCloseChunk

public void addAndCloseChunk(Chunk c,
                             Futures fs)

close

public void close(water.fvec.C1NChunk c,
                  int cidx,
                  Futures fs)

chunkIdx

public Value chunkIdx(int cidx)

Description copied from class: Vec

Get a Chunk's Value by index. Basically the index-to-key map, plus the DKV.get(). Warning: this pulls the data locally; using this call on every Chunk index on the same node will probably trigger an OOM!

Overrides:

chunkIdx in class FileVec

readPut

public static Key readPut(java.lang.String keyname,
                          java.io.InputStream is,
                          UploadFileVec.ReadPutStats stats)
                   throws java.io.IOException

Throws:

java.io.IOException

readPut

public static Key readPut(Key k,
                          java.io.InputStream is,
                          UploadFileVec.ReadPutStats stats)
                   throws java.io.IOException

Throws:

java.io.IOException

setChunkSize

public int setChunkSize(Frame fr,
                        int chunkSize)

Overrides:

setChunkSize in class FileVec