\section{Drop\+Connect$<$ Input\+Data\+Type, Output\+Data\+Type $>$ Class Template Reference} \label{classmlpack_1_1ann_1_1DropConnect}\index{Drop\+Connect$<$ Input\+Data\+Type, Output\+Data\+Type $>$@{Drop\+Connect$<$ Input\+Data\+Type, Output\+Data\+Type $>$}} The \doxyref{Drop\+Connect}{p.}{classmlpack_1_1ann_1_1DropConnect} layer is a regularizer that randomly with probability ratio sets the connection values to zero and scales the remaining elements by factor 1 /(1 -\/ ratio). \subsection*{Public Member Functions} \begin{DoxyCompactItemize} \item \textbf{ Drop\+Connect} () \begin{DoxyCompactList}\small\item\em Create the \doxyref{Drop\+Connect}{p.}{classmlpack_1_1ann_1_1DropConnect} object. \end{DoxyCompactList}\item \textbf{ Drop\+Connect} (const size\+\_\+t in\+Size, const size\+\_\+t out\+Size, const double ratio=0.\+5) \begin{DoxyCompactList}\small\item\em Creates the \doxyref{Drop\+Connect}{p.}{classmlpack_1_1ann_1_1DropConnect} Layer as a \doxyref{Linear}{p.}{classmlpack_1_1ann_1_1Linear} Object that takes input size, output size and ratio as parameter. \end{DoxyCompactList}\item {\footnotesize template$<$typename eT $>$ }\\void \textbf{ Backward} (const arma\+::\+Mat$<$ eT $>$ \&input, const arma\+::\+Mat$<$ eT $>$ \&gy, arma\+::\+Mat$<$ eT $>$ \&g) \begin{DoxyCompactList}\small\item\em Ordinary feed backward pass of the \doxyref{Drop\+Connect}{p.}{classmlpack_1_1ann_1_1DropConnect} layer. \end{DoxyCompactList}\item Output\+Data\+Type const \& \textbf{ Delta} () const \begin{DoxyCompactList}\small\item\em Get the delta. \end{DoxyCompactList}\item Output\+Data\+Type \& \textbf{ Delta} () \begin{DoxyCompactList}\small\item\em Modify the delta. \end{DoxyCompactList}\item bool \textbf{ Deterministic} () const \begin{DoxyCompactList}\small\item\em The value of the deterministic parameter. \end{DoxyCompactList}\item bool \& \textbf{ Deterministic} () \begin{DoxyCompactList}\small\item\em Modify the value of the deterministic parameter. \end{DoxyCompactList}\item {\footnotesize template$<$typename eT $>$ }\\void \textbf{ Forward} (const arma\+::\+Mat$<$ eT $>$ \&input, arma\+::\+Mat$<$ eT $>$ \&output) \begin{DoxyCompactList}\small\item\em Ordinary feed forward pass of the \doxyref{Drop\+Connect}{p.}{classmlpack_1_1ann_1_1DropConnect} layer. \end{DoxyCompactList}\item {\footnotesize template$<$typename eT $>$ }\\void \textbf{ Gradient} (const arma\+::\+Mat$<$ eT $>$ \&input, const arma\+::\+Mat$<$ eT $>$ \&error, arma\+::\+Mat$<$ eT $>$ \&) \begin{DoxyCompactList}\small\item\em Calculate the gradient using the output delta and the input activation. \end{DoxyCompactList}\item Output\+Data\+Type const \& \textbf{ Gradient} () const \begin{DoxyCompactList}\small\item\em Get the gradient. \end{DoxyCompactList}\item Output\+Data\+Type \& \textbf{ Gradient} () \begin{DoxyCompactList}\small\item\em Modify the gradient. \end{DoxyCompactList}\item std\+::vector$<$ \textbf{ Layer\+Types}$<$$>$ $>$ \& \textbf{ Model} () \begin{DoxyCompactList}\small\item\em Get the model modules. \end{DoxyCompactList}\item Output\+Data\+Type const \& \textbf{ Output\+Parameter} () const \begin{DoxyCompactList}\small\item\em Get the output parameter. \end{DoxyCompactList}\item Output\+Data\+Type \& \textbf{ Output\+Parameter} () \begin{DoxyCompactList}\small\item\em Modify the output parameter. \end{DoxyCompactList}\item Output\+Data\+Type const \& \textbf{ Parameters} () const \begin{DoxyCompactList}\small\item\em Get the parameters. \end{DoxyCompactList}\item Output\+Data\+Type \& \textbf{ Parameters} () \begin{DoxyCompactList}\small\item\em Modify the parameters. \end{DoxyCompactList}\item double \textbf{ Ratio} () const \begin{DoxyCompactList}\small\item\em The probability of setting a value to zero. \end{DoxyCompactList}\item void \textbf{ Ratio} (const double r) \begin{DoxyCompactList}\small\item\em Modify the probability of setting a value to zero. \end{DoxyCompactList}\item {\footnotesize template$<$typename Archive $>$ }\\void \textbf{ serialize} (Archive \&ar, const unsigned int) \begin{DoxyCompactList}\small\item\em Serialize the layer. \end{DoxyCompactList}\end{DoxyCompactItemize} \subsection{Detailed Description} \subsubsection*{template$<$typename Input\+Data\+Type = arma\+::mat, typename Output\+Data\+Type = arma\+::mat$>$\newline class mlpack\+::ann\+::\+Drop\+Connect$<$ Input\+Data\+Type, Output\+Data\+Type $>$} The \doxyref{Drop\+Connect}{p.}{classmlpack_1_1ann_1_1DropConnect} layer is a regularizer that randomly with probability ratio sets the connection values to zero and scales the remaining elements by factor 1 /(1 -\/ ratio). The output is scaled with 1 / (1 -\/ p) when deterministic is false. In the deterministic mode(during testing), the layer just computes the output. The output is computed according to the input layer. If no input layer is given, it will take a linear layer as default. Note\+: During training you should set deterministic to false and during testing you should set deterministic to true. For more information, see the following. \begin{DoxyCode} @inproceedings\{WanICML2013, title=\{Regularization of Neural Networks \textcolor{keyword}{using} DropConnect\}, booktitle = \{Proceedings of the 30th International Conference on Machine Learning(ICML - 13)\}, author = \{Li Wan and Matthew Zeiler and Sixin Zhang and Yann L. Cun and Rob Fergus\}, year = \{2013\}, url = \{http:\textcolor{comment}{//proceedings.mlr.press/v28/wan13.pdf\}} \} \end{DoxyCode} \begin{DoxyTemplParams}{Template Parameters} {\em Input\+Data\+Type} & Type of the input data (arma\+::colvec, arma\+::mat, arma\+::sp\+\_\+mat or arma\+::cube). \\ \hline {\em Output\+Data\+Type} & Type of the output data (arma\+::colvec, arma\+::mat, arma\+::sp\+\_\+mat or arma\+::cube). \\ \hline \end{DoxyTemplParams} Definition at line 63 of file dropconnect.\+hpp. \subsection{Constructor \& Destructor Documentation} \mbox{\label{classmlpack_1_1ann_1_1DropConnect_a8dbbcddcb47c7d048d0094b4619f71ac}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Drop\+Connect@{Drop\+Connect}} \index{Drop\+Connect@{Drop\+Connect}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Drop\+Connect()\hspace{0.1cm}{\footnotesize\ttfamily [1/2]}} {\footnotesize\ttfamily \textbf{ Drop\+Connect} (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})} Create the \doxyref{Drop\+Connect}{p.}{classmlpack_1_1ann_1_1DropConnect} object. \mbox{\label{classmlpack_1_1ann_1_1DropConnect_a693f017e99094d956f4c88e1b47acdf0}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Drop\+Connect@{Drop\+Connect}} \index{Drop\+Connect@{Drop\+Connect}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Drop\+Connect()\hspace{0.1cm}{\footnotesize\ttfamily [2/2]}} {\footnotesize\ttfamily \textbf{ Drop\+Connect} (\begin{DoxyParamCaption}\item[{const size\+\_\+t}]{in\+Size, }\item[{const size\+\_\+t}]{out\+Size, }\item[{const double}]{ratio = {\ttfamily 0.5} }\end{DoxyParamCaption})} Creates the \doxyref{Drop\+Connect}{p.}{classmlpack_1_1ann_1_1DropConnect} Layer as a \doxyref{Linear}{p.}{classmlpack_1_1ann_1_1Linear} Object that takes input size, output size and ratio as parameter. \begin{DoxyParams}{Parameters} {\em in\+Size} & The number of input units. \\ \hline {\em out\+Size} & The number of output units. \\ \hline {\em ratio} & The probability of setting a value to zero. \\ \hline \end{DoxyParams} \subsection{Member Function Documentation} \mbox{\label{classmlpack_1_1ann_1_1DropConnect_a78dbad83871f43db1975e45a9a69c376}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Backward@{Backward}} \index{Backward@{Backward}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Backward()} {\footnotesize\ttfamily void Backward (\begin{DoxyParamCaption}\item[{const arma\+::\+Mat$<$ eT $>$ \&}]{input, }\item[{const arma\+::\+Mat$<$ eT $>$ \&}]{gy, }\item[{arma\+::\+Mat$<$ eT $>$ \&}]{g }\end{DoxyParamCaption})} Ordinary feed backward pass of the \doxyref{Drop\+Connect}{p.}{classmlpack_1_1ann_1_1DropConnect} layer. \begin{DoxyParams}{Parameters} {\em input} & The propagated input activation. \\ \hline {\em gy} & The backpropagated error. \\ \hline {\em g} & The calculated gradient. \\ \hline \end{DoxyParams} \mbox{\label{classmlpack_1_1ann_1_1DropConnect_a797f7edb44dd081e5e2b3cc316eef6bd}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Delta@{Delta}} \index{Delta@{Delta}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Delta()\hspace{0.1cm}{\footnotesize\ttfamily [1/2]}} {\footnotesize\ttfamily Output\+Data\+Type const\& Delta (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption}) const\hspace{0.3cm}{\ttfamily [inline]}} Get the delta. Definition at line 128 of file dropconnect.\+hpp. \mbox{\label{classmlpack_1_1ann_1_1DropConnect_ad6601342d560219ce951d554e69e5e87}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Delta@{Delta}} \index{Delta@{Delta}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Delta()\hspace{0.1cm}{\footnotesize\ttfamily [2/2]}} {\footnotesize\ttfamily Output\+Data\+Type\& Delta (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Modify the delta. Definition at line 130 of file dropconnect.\+hpp. \mbox{\label{classmlpack_1_1ann_1_1DropConnect_a9f4103707f4d199ce5594d239b60443e}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Deterministic@{Deterministic}} \index{Deterministic@{Deterministic}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Deterministic()\hspace{0.1cm}{\footnotesize\ttfamily [1/2]}} {\footnotesize\ttfamily bool Deterministic (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption}) const\hspace{0.3cm}{\ttfamily [inline]}} The value of the deterministic parameter. Definition at line 138 of file dropconnect.\+hpp. \mbox{\label{classmlpack_1_1ann_1_1DropConnect_a42d4ee3da432cff20d3a41b8b1ec801c}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Deterministic@{Deterministic}} \index{Deterministic@{Deterministic}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Deterministic()\hspace{0.1cm}{\footnotesize\ttfamily [2/2]}} {\footnotesize\ttfamily bool\& Deterministic (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Modify the value of the deterministic parameter. Definition at line 141 of file dropconnect.\+hpp. \mbox{\label{classmlpack_1_1ann_1_1DropConnect_a461f849bc638c15bec262dc9c3a58abe}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Forward@{Forward}} \index{Forward@{Forward}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Forward()} {\footnotesize\ttfamily void Forward (\begin{DoxyParamCaption}\item[{const arma\+::\+Mat$<$ eT $>$ \&}]{input, }\item[{arma\+::\+Mat$<$ eT $>$ \&}]{output }\end{DoxyParamCaption})} Ordinary feed forward pass of the \doxyref{Drop\+Connect}{p.}{classmlpack_1_1ann_1_1DropConnect} layer. \begin{DoxyParams}{Parameters} {\em input} & Input data used for evaluating the specified function. \\ \hline {\em output} & Resulting output activation. \\ \hline \end{DoxyParams} \mbox{\label{classmlpack_1_1ann_1_1DropConnect_a505acb56ef67da2fc73190d3d4931969}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Gradient@{Gradient}} \index{Gradient@{Gradient}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Gradient()\hspace{0.1cm}{\footnotesize\ttfamily [1/3]}} {\footnotesize\ttfamily void Gradient (\begin{DoxyParamCaption}\item[{const arma\+::\+Mat$<$ eT $>$ \&}]{input, }\item[{const arma\+::\+Mat$<$ eT $>$ \&}]{error, }\item[{arma\+::\+Mat$<$ eT $>$ \&}]{ }\end{DoxyParamCaption})} Calculate the gradient using the output delta and the input activation. \begin{DoxyParams}{Parameters} {\em input} & The propagated input. \\ \hline {\em d} & The calculated error. \\ \hline {\em g} & The calculated gradient. \\ \hline \end{DoxyParams} \mbox{\label{classmlpack_1_1ann_1_1DropConnect_a0f1f4e6d93472d83852731a96c8c3f59}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Gradient@{Gradient}} \index{Gradient@{Gradient}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Gradient()\hspace{0.1cm}{\footnotesize\ttfamily [2/3]}} {\footnotesize\ttfamily Output\+Data\+Type const\& Gradient (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption}) const\hspace{0.3cm}{\ttfamily [inline]}} Get the gradient. Definition at line 133 of file dropconnect.\+hpp. \mbox{\label{classmlpack_1_1ann_1_1DropConnect_a19abce4739c3b0b658b612537e21956a}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Gradient@{Gradient}} \index{Gradient@{Gradient}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Gradient()\hspace{0.1cm}{\footnotesize\ttfamily [3/3]}} {\footnotesize\ttfamily Output\+Data\+Type\& Gradient (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Modify the gradient. Definition at line 135 of file dropconnect.\+hpp. \mbox{\label{classmlpack_1_1ann_1_1DropConnect_a50c707b4f7c009339d8d661539baf38f}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Model@{Model}} \index{Model@{Model}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Model()} {\footnotesize\ttfamily std\+::vector$<$\textbf{ Layer\+Types}$<$$>$ $>$\& Model (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Get the model modules. Definition at line 115 of file dropconnect.\+hpp. \mbox{\label{classmlpack_1_1ann_1_1DropConnect_a0ee21c2a36e5abad1e7a9d5dd00849f9}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Output\+Parameter@{Output\+Parameter}} \index{Output\+Parameter@{Output\+Parameter}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Output\+Parameter()\hspace{0.1cm}{\footnotesize\ttfamily [1/2]}} {\footnotesize\ttfamily Output\+Data\+Type const\& Output\+Parameter (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption}) const\hspace{0.3cm}{\ttfamily [inline]}} Get the output parameter. Definition at line 123 of file dropconnect.\+hpp. \mbox{\label{classmlpack_1_1ann_1_1DropConnect_a21d5f745f02c709625a4ee0907f004a5}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Output\+Parameter@{Output\+Parameter}} \index{Output\+Parameter@{Output\+Parameter}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Output\+Parameter()\hspace{0.1cm}{\footnotesize\ttfamily [2/2]}} {\footnotesize\ttfamily Output\+Data\+Type\& Output\+Parameter (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Modify the output parameter. Definition at line 125 of file dropconnect.\+hpp. \mbox{\label{classmlpack_1_1ann_1_1DropConnect_aa530552c7ef915c952fbacc77b965c90}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Parameters@{Parameters}} \index{Parameters@{Parameters}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Parameters()\hspace{0.1cm}{\footnotesize\ttfamily [1/2]}} {\footnotesize\ttfamily Output\+Data\+Type const\& Parameters (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption}) const\hspace{0.3cm}{\ttfamily [inline]}} Get the parameters. Definition at line 118 of file dropconnect.\+hpp. \mbox{\label{classmlpack_1_1ann_1_1DropConnect_a9c5c5900772a689d5a6b59778ec67120}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Parameters@{Parameters}} \index{Parameters@{Parameters}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Parameters()\hspace{0.1cm}{\footnotesize\ttfamily [2/2]}} {\footnotesize\ttfamily Output\+Data\+Type\& Parameters (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Modify the parameters. Definition at line 120 of file dropconnect.\+hpp. \mbox{\label{classmlpack_1_1ann_1_1DropConnect_a0052f2d1427761ea25fb01a05d966a40}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Ratio@{Ratio}} \index{Ratio@{Ratio}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Ratio()\hspace{0.1cm}{\footnotesize\ttfamily [1/2]}} {\footnotesize\ttfamily double Ratio (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption}) const\hspace{0.3cm}{\ttfamily [inline]}} The probability of setting a value to zero. Definition at line 144 of file dropconnect.\+hpp. \mbox{\label{classmlpack_1_1ann_1_1DropConnect_a9ca65c8f62aa7b45b5b08899d83d2821}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!Ratio@{Ratio}} \index{Ratio@{Ratio}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{Ratio()\hspace{0.1cm}{\footnotesize\ttfamily [2/2]}} {\footnotesize\ttfamily void Ratio (\begin{DoxyParamCaption}\item[{const double}]{r }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Modify the probability of setting a value to zero. Definition at line 147 of file dropconnect.\+hpp. References Drop\+Connect$<$ Input\+Data\+Type, Output\+Data\+Type $>$\+::serialize(). \mbox{\label{classmlpack_1_1ann_1_1DropConnect_af0dd9205158ccf7bcfcd8ff81f79c927}} \index{mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}!serialize@{serialize}} \index{serialize@{serialize}!mlpack\+::ann\+::\+Drop\+Connect@{mlpack\+::ann\+::\+Drop\+Connect}} \subsubsection{serialize()} {\footnotesize\ttfamily void serialize (\begin{DoxyParamCaption}\item[{Archive \&}]{ar, }\item[{const unsigned}]{int }\end{DoxyParamCaption})} Serialize the layer. Referenced by Drop\+Connect$<$ Input\+Data\+Type, Output\+Data\+Type $>$\+::\+Ratio(). The documentation for this class was generated from the following file\+:\begin{DoxyCompactItemize} \item /var/www/mlpack.\+ratml.\+org/mlpack.\+org/\+\_\+src/mlpack-\/3.\+3.\+1/src/mlpack/methods/ann/layer/\textbf{ dropconnect.\+hpp}\end{DoxyCompactItemize}