hex.deeplearning

Class Neurons.Maxout

java.lang.Object

hex.deeplearning.Neurons

hex.deeplearning.Neurons.Maxout

Direct Known Subclasses:

Neurons.MaxoutDropout

Enclosing class:

Neurons

public static class Neurons.Maxout
extends Neurons

Maxout neurons (picks the max out of the k activation_j = sum(A_ij*x_i) + b_j) Requires k times the model parameters (weights/biases) as a "normal" neuron

Nested Class Summary

Nested classes/interfaces inherited from class hex.deeplearning.Neurons

Neurons.ExpRectifier, Neurons.ExpRectifierDropout, Neurons.Input, Neurons.Linear, Neurons.Maxout, Neurons.MaxoutDropout, Neurons.Output, Neurons.Rectifier, Neurons.RectifierDropout, Neurons.Softmax, Neurons.Tanh, Neurons.TanhDropout

Field Summary

Fields inherited from class hex.deeplearning.Neurons

_a, _avg_a, _b, _bEA, _dropout, _e, _index, _input, _origa, _previous, _w, _wEA, params, units

Constructor Summary

Constructors

Constructor and Description
Maxout(DeepLearningModel.DeepLearningParameters params, short k, int units)

Method Summary

Modifier and Type	Method and Description
protected void	bprop(int n) Back propagation of error terms stored in _e (for non-final layers)
protected void	fprop(long seed, boolean training, int n) Forward propagation

Methods inherited from class hex.deeplearning.Neurons

autoEncoderGradient, bpropOutputLayer, init, momentum, momentum, rate, setOutputLayerGradient, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

Maxout

public Maxout(DeepLearningModel.DeepLearningParameters params,
              short k,
              int units)

Method Detail

fprop

protected void fprop(long seed,
                     boolean training,
                     int n)

Description copied from class: Neurons

Forward propagation

Specified by:

fprop in class Neurons

Parameters:

seed - For seeding the RNG inside (for dropout)

training - Whether training is done or just testing (no need for dropout)

n - number of actually trained samples in this mini-batch

bprop

protected void bprop(int n)

Description copied from class: Neurons

Back propagation of error terms stored in _e (for non-final layers)

Specified by:

bprop in class Neurons