ELU< InputDataType, OutputDataType > Class Template Reference

The ELU activation function, defined by. More...

Public Member Functions
	ELU (const double alpha=1.0)
	Create the ELU object using the specified parameters. More...
double const &	Alpha () const
	Get the non zero gradient. More...
double &	Alpha ()
	Modify the non zero gradient. More...
template < typename DataType >
void	Backward (const DataType &&input, DataType &&gy, DataType &&g)
	Ordinary feed backward pass of a neural network, calculating the function f(x) by propagating x backwards through f. More...
OutputDataType const &	Delta () const
	Get the delta. More...
OutputDataType &	Delta ()
	Modify the delta. More...
template < typename InputType , typename OutputType >
void	Forward (const InputType &&input, OutputType &&output)
	Ordinary feed forward pass of a neural network, evaluating the function f(x) by propagating the activity forward through f. More...
InputDataType const &	InputParameter () const
	Get the input parameter. More...
InputDataType &	InputParameter ()
	Modify the input parameter. More...
OutputDataType const &	OutputParameter () const
	Get the output parameter. More...
OutputDataType &	OutputParameter ()
	Modify the output parameter. More...
template < typename Archive >
void	serialize (Archive &ar, const unsigned int)
	Serialize the layer. More...

Detailed Description

template

<

typename

InputDataType

=

arma::mat

,

typename

OutputDataType

=

arma::mat

>

class mlpack::ann::ELU< InputDataType, OutputDataType >

The ELU activation function, defined by.

Template Parameters

InputDataType	Type of the input data (arma::colvec, arma::mat, arma::sp_mat or arma::cube).
OutputDataType	Type of the output data (arma::colvec, arma::mat, arma::sp_mat or arma::cube).

Definition at line 61 of file elu.hpp.

Constructor & Destructor Documentation

ELU()

ELU

(

const double

alpha = 1.0

)

Create the ELU object using the specified parameters.

The non zero gradient for negative inputs can be adjusted by specifying the ELU hyperparameter alpha (alpha > 0).

Parameters

alpha

Scale parameter for the negative factor (Default alpha = 1.0).

Member Function Documentation

Alpha() [1/2]

double const& Alpha ( ) const

inline

Get the non zero gradient.

Definition at line 111 of file elu.hpp.

Alpha() [2/2]

double& Alpha ( )

inline

Modify the non zero gradient.

Definition at line 113 of file elu.hpp.

References ELU< InputDataType, OutputDataType >::serialize().

Backward()

void Backward	(	const DataType &&	input,
		DataType &&	gy,
		DataType &&	g
	)

Ordinary feed backward pass of a neural network, calculating the function f(x) by propagating x backwards through f.

Using the results from the feed forward pass.

Parameters

input	The propagated input activation.
gy	The backpropagated error.
g	The calculated gradient.

Delta() [1/2]

OutputDataType const& Delta ( ) const

inline

Get the delta.

Definition at line 106 of file elu.hpp.

Delta() [2/2]

OutputDataType& Delta ( )

inline

Modify the delta.

Definition at line 108 of file elu.hpp.

Forward()

void Forward	(	const InputType &&	input,
		OutputType &&	output
	)

Ordinary feed forward pass of a neural network, evaluating the function f(x) by propagating the activity forward through f.

Parameters

input	Input data used for evaluating the specified function.
output	Resulting output activation.

InputParameter() [1/2]

InputDataType const& InputParameter ( ) const

inline

Get the input parameter.

Definition at line 96 of file elu.hpp.

InputParameter() [2/2]

InputDataType& InputParameter ( )

inline

Modify the input parameter.

Definition at line 98 of file elu.hpp.

OutputParameter() [1/2]

OutputDataType const& OutputParameter ( ) const

inline

Get the output parameter.

Definition at line 101 of file elu.hpp.

OutputParameter() [2/2]

OutputDataType& OutputParameter ( )

inline

Modify the output parameter.

Definition at line 103 of file elu.hpp.

serialize()

void serialize	(	Archive &	ar,
		const unsigned	int
	)

Serialize the layer.

Referenced by ELU< InputDataType, OutputDataType >::Alpha().

---

The documentation for this class was generated from the following file:

• src/mlpack/methods/ann/layer/elu.hpp