\section{Training\+Config Class Reference} \label{classmlpack_1_1rl_1_1TrainingConfig}\index{Training\+Config@{Training\+Config}} \subsection*{Public Member Functions} \begin{DoxyCompactItemize} \item \textbf{ Training\+Config} () \item \textbf{ Training\+Config} (size\+\_\+t num\+Workers, size\+\_\+t update\+Interval, size\+\_\+t target\+Network\+Sync\+Interval, size\+\_\+t step\+Limit, size\+\_\+t exploration\+Steps, double step\+Size, double discount, double gradient\+Limit, bool double\+Q\+Learning) \item double \textbf{ Discount} () const \begin{DoxyCompactList}\small\item\em Get the discount rate for future reward. \end{DoxyCompactList}\item double \& \textbf{ Discount} () \begin{DoxyCompactList}\small\item\em Modify the discount rate for future reward. \end{DoxyCompactList}\item bool \textbf{ Double\+Q\+Learning} () const \begin{DoxyCompactList}\small\item\em Get the indicator of double q-\/learning. \end{DoxyCompactList}\item bool \& \textbf{ Double\+Q\+Learning} () \begin{DoxyCompactList}\small\item\em Modify the indicator of double q-\/learning. \end{DoxyCompactList}\item size\+\_\+t \textbf{ Exploration\+Steps} () const \begin{DoxyCompactList}\small\item\em Get the exploration steps. \end{DoxyCompactList}\item size\+\_\+t \& \textbf{ Exploration\+Steps} () \begin{DoxyCompactList}\small\item\em Modify the exploration steps. \end{DoxyCompactList}\item double \textbf{ Gradient\+Limit} () const \begin{DoxyCompactList}\small\item\em Get the limit of update gradient. \end{DoxyCompactList}\item double \& \textbf{ Gradient\+Limit} () \begin{DoxyCompactList}\small\item\em Modify the limit of update gradient. \end{DoxyCompactList}\item size\+\_\+t \textbf{ Num\+Workers} () const \begin{DoxyCompactList}\small\item\em Get the amount of workers. \end{DoxyCompactList}\item size\+\_\+t \& \textbf{ Num\+Workers} () \begin{DoxyCompactList}\small\item\em Modify the amount of workers. \end{DoxyCompactList}\item size\+\_\+t \textbf{ Step\+Limit} () const \begin{DoxyCompactList}\small\item\em Get the maximum steps of each episode. \end{DoxyCompactList}\item size\+\_\+t \& \textbf{ Step\+Limit} () \begin{DoxyCompactList}\small\item\em Modify the maximum steps of each episode. \end{DoxyCompactList}\item double \textbf{ Step\+Size} () const \begin{DoxyCompactList}\small\item\em Get the step size of the optimizer. \end{DoxyCompactList}\item double \& \textbf{ Step\+Size} () \begin{DoxyCompactList}\small\item\em Modify the step size of the optimizer. \end{DoxyCompactList}\item size\+\_\+t \textbf{ Target\+Network\+Sync\+Interval} () const \begin{DoxyCompactList}\small\item\em Get the interval for syncing target network. \end{DoxyCompactList}\item size\+\_\+t \& \textbf{ Target\+Network\+Sync\+Interval} () \begin{DoxyCompactList}\small\item\em Modify the interval for syncing target network. \end{DoxyCompactList}\item size\+\_\+t \textbf{ Update\+Interval} () const \begin{DoxyCompactList}\small\item\em Get the update interval. \end{DoxyCompactList}\item size\+\_\+t \& \textbf{ Update\+Interval} () \begin{DoxyCompactList}\small\item\em Modify the update interval. \end{DoxyCompactList}\end{DoxyCompactItemize} \subsection{Detailed Description} Definition at line 19 of file training\+\_\+config.\+hpp. \subsection{Constructor \& Destructor Documentation} \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_a3019009601a109962148cd8ba5505217}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Training\+Config@{Training\+Config}} \index{Training\+Config@{Training\+Config}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Training\+Config()\hspace{0.1cm}{\footnotesize\ttfamily [1/2]}} {\footnotesize\ttfamily \textbf{ Training\+Config} (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Definition at line 22 of file training\+\_\+config.\+hpp. \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_abeeb4d2b728778462bcf8846cad50747}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Training\+Config@{Training\+Config}} \index{Training\+Config@{Training\+Config}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Training\+Config()\hspace{0.1cm}{\footnotesize\ttfamily [2/2]}} {\footnotesize\ttfamily \textbf{ Training\+Config} (\begin{DoxyParamCaption}\item[{size\+\_\+t}]{num\+Workers, }\item[{size\+\_\+t}]{update\+Interval, }\item[{size\+\_\+t}]{target\+Network\+Sync\+Interval, }\item[{size\+\_\+t}]{step\+Limit, }\item[{size\+\_\+t}]{exploration\+Steps, }\item[{double}]{step\+Size, }\item[{double}]{discount, }\item[{double}]{gradient\+Limit, }\item[{bool}]{double\+Q\+Learning }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Definition at line 31 of file training\+\_\+config.\+hpp. \subsection{Member Function Documentation} \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_aa6ad347e43fbd017a857577c98b2c60a}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Discount@{Discount}} \index{Discount@{Discount}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Discount()\hspace{0.1cm}{\footnotesize\ttfamily [1/2]}} {\footnotesize\ttfamily double Discount (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption}) const\hspace{0.3cm}{\ttfamily [inline]}} Get the discount rate for future reward. Definition at line 87 of file training\+\_\+config.\+hpp. Referenced by N\+Step\+Q\+Learning\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(), One\+Step\+Q\+Learning\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(), and One\+Step\+Sarsa\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(). \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_acac458c2ea9b4b4f1d48bd9cff986bae}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Discount@{Discount}} \index{Discount@{Discount}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Discount()\hspace{0.1cm}{\footnotesize\ttfamily [2/2]}} {\footnotesize\ttfamily double\& Discount (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Modify the discount rate for future reward. Definition at line 89 of file training\+\_\+config.\+hpp. \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_a5ba88e606db2e58eefb3930c0fe4bbd3}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Double\+Q\+Learning@{Double\+Q\+Learning}} \index{Double\+Q\+Learning@{Double\+Q\+Learning}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Double\+Q\+Learning()\hspace{0.1cm}{\footnotesize\ttfamily [1/2]}} {\footnotesize\ttfamily bool Double\+Q\+Learning (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption}) const\hspace{0.3cm}{\ttfamily [inline]}} Get the indicator of double q-\/learning. Definition at line 97 of file training\+\_\+config.\+hpp. \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_a5b1dece1cfbb6e22e8bfd35002bb0aa5}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Double\+Q\+Learning@{Double\+Q\+Learning}} \index{Double\+Q\+Learning@{Double\+Q\+Learning}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Double\+Q\+Learning()\hspace{0.1cm}{\footnotesize\ttfamily [2/2]}} {\footnotesize\ttfamily bool\& Double\+Q\+Learning (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Modify the indicator of double q-\/learning. Definition at line 99 of file training\+\_\+config.\+hpp. \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_a152e5eb946b9733ad6032403bae7cc85}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Exploration\+Steps@{Exploration\+Steps}} \index{Exploration\+Steps@{Exploration\+Steps}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Exploration\+Steps()\hspace{0.1cm}{\footnotesize\ttfamily [1/2]}} {\footnotesize\ttfamily size\+\_\+t Exploration\+Steps (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption}) const\hspace{0.3cm}{\ttfamily [inline]}} Get the exploration steps. Definition at line 77 of file training\+\_\+config.\+hpp. \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_afa61655c677211db7194648c2be1b0ba}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Exploration\+Steps@{Exploration\+Steps}} \index{Exploration\+Steps@{Exploration\+Steps}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Exploration\+Steps()\hspace{0.1cm}{\footnotesize\ttfamily [2/2]}} {\footnotesize\ttfamily size\+\_\+t\& Exploration\+Steps (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Modify the exploration steps. Definition at line 79 of file training\+\_\+config.\+hpp. \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_a47c21c74b98a88391e1d4acb707fb930}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Gradient\+Limit@{Gradient\+Limit}} \index{Gradient\+Limit@{Gradient\+Limit}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Gradient\+Limit()\hspace{0.1cm}{\footnotesize\ttfamily [1/2]}} {\footnotesize\ttfamily double Gradient\+Limit (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption}) const\hspace{0.3cm}{\ttfamily [inline]}} Get the limit of update gradient. Definition at line 92 of file training\+\_\+config.\+hpp. Referenced by N\+Step\+Q\+Learning\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(), One\+Step\+Q\+Learning\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(), and One\+Step\+Sarsa\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(). \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_ae2f246d60c5d8fbebd3218063fe3d752}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Gradient\+Limit@{Gradient\+Limit}} \index{Gradient\+Limit@{Gradient\+Limit}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Gradient\+Limit()\hspace{0.1cm}{\footnotesize\ttfamily [2/2]}} {\footnotesize\ttfamily double\& Gradient\+Limit (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Modify the limit of update gradient. Definition at line 94 of file training\+\_\+config.\+hpp. \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_a924fc92508c8bd78b50b0859e039b4f6}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Num\+Workers@{Num\+Workers}} \index{Num\+Workers@{Num\+Workers}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Num\+Workers()\hspace{0.1cm}{\footnotesize\ttfamily [1/2]}} {\footnotesize\ttfamily size\+\_\+t Num\+Workers (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption}) const\hspace{0.3cm}{\ttfamily [inline]}} Get the amount of workers. Definition at line 53 of file training\+\_\+config.\+hpp. \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_a0c9a438aa9ae517c2c0d79a1d9c91143}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Num\+Workers@{Num\+Workers}} \index{Num\+Workers@{Num\+Workers}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Num\+Workers()\hspace{0.1cm}{\footnotesize\ttfamily [2/2]}} {\footnotesize\ttfamily size\+\_\+t\& Num\+Workers (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Modify the amount of workers. Definition at line 55 of file training\+\_\+config.\+hpp. \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_ac5d0f7fbe2c8d6222464e0d828073051}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Step\+Limit@{Step\+Limit}} \index{Step\+Limit@{Step\+Limit}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Step\+Limit()\hspace{0.1cm}{\footnotesize\ttfamily [1/2]}} {\footnotesize\ttfamily size\+\_\+t Step\+Limit (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption}) const\hspace{0.3cm}{\ttfamily [inline]}} Get the maximum steps of each episode. Definition at line 69 of file training\+\_\+config.\+hpp. Referenced by N\+Step\+Q\+Learning\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(), One\+Step\+Q\+Learning\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(), and One\+Step\+Sarsa\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(). \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_a8affdbc5f4db5e3f62e0e56a1e7de599}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Step\+Limit@{Step\+Limit}} \index{Step\+Limit@{Step\+Limit}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Step\+Limit()\hspace{0.1cm}{\footnotesize\ttfamily [2/2]}} {\footnotesize\ttfamily size\+\_\+t\& Step\+Limit (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Modify the maximum steps of each episode. Setting it to 0 means no limit. Definition at line 74 of file training\+\_\+config.\+hpp. \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_a11e6eb66d82a14ebd2943b49db676444}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Step\+Size@{Step\+Size}} \index{Step\+Size@{Step\+Size}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Step\+Size()\hspace{0.1cm}{\footnotesize\ttfamily [1/2]}} {\footnotesize\ttfamily double Step\+Size (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption}) const\hspace{0.3cm}{\ttfamily [inline]}} Get the step size of the optimizer. Definition at line 82 of file training\+\_\+config.\+hpp. Referenced by N\+Step\+Q\+Learning\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(), One\+Step\+Q\+Learning\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(), and One\+Step\+Sarsa\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(). \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_af6b273aba48a984b2847aa1593e09477}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Step\+Size@{Step\+Size}} \index{Step\+Size@{Step\+Size}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Step\+Size()\hspace{0.1cm}{\footnotesize\ttfamily [2/2]}} {\footnotesize\ttfamily double\& Step\+Size (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Modify the step size of the optimizer. Definition at line 84 of file training\+\_\+config.\+hpp. \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_ad050465e611df6ecca98f5d98a785f03}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Target\+Network\+Sync\+Interval@{Target\+Network\+Sync\+Interval}} \index{Target\+Network\+Sync\+Interval@{Target\+Network\+Sync\+Interval}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Target\+Network\+Sync\+Interval()\hspace{0.1cm}{\footnotesize\ttfamily [1/2]}} {\footnotesize\ttfamily size\+\_\+t Target\+Network\+Sync\+Interval (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption}) const\hspace{0.3cm}{\ttfamily [inline]}} Get the interval for syncing target network. Definition at line 63 of file training\+\_\+config.\+hpp. Referenced by N\+Step\+Q\+Learning\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(), One\+Step\+Q\+Learning\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(), and One\+Step\+Sarsa\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(). \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_a44fc92866e2a5ac3c9bbaebac71b8a62}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Target\+Network\+Sync\+Interval@{Target\+Network\+Sync\+Interval}} \index{Target\+Network\+Sync\+Interval@{Target\+Network\+Sync\+Interval}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Target\+Network\+Sync\+Interval()\hspace{0.1cm}{\footnotesize\ttfamily [2/2]}} {\footnotesize\ttfamily size\+\_\+t\& Target\+Network\+Sync\+Interval (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Modify the interval for syncing target network. Definition at line 66 of file training\+\_\+config.\+hpp. \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_a3e73fbeca5eb5ab314f65094f59d63b2}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Update\+Interval@{Update\+Interval}} \index{Update\+Interval@{Update\+Interval}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Update\+Interval()\hspace{0.1cm}{\footnotesize\ttfamily [1/2]}} {\footnotesize\ttfamily size\+\_\+t Update\+Interval (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption}) const\hspace{0.3cm}{\ttfamily [inline]}} Get the update interval. Definition at line 58 of file training\+\_\+config.\+hpp. Referenced by N\+Step\+Q\+Learning\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(), One\+Step\+Q\+Learning\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(), and One\+Step\+Sarsa\+Worker$<$ Environment\+Type, Network\+Type, Updater\+Type, Policy\+Type $>$\+::\+Step(). \mbox{\label{classmlpack_1_1rl_1_1TrainingConfig_a8ff4385395b639358c1e392696a7469f}} \index{mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}!Update\+Interval@{Update\+Interval}} \index{Update\+Interval@{Update\+Interval}!mlpack\+::rl\+::\+Training\+Config@{mlpack\+::rl\+::\+Training\+Config}} \subsubsection{Update\+Interval()\hspace{0.1cm}{\footnotesize\ttfamily [2/2]}} {\footnotesize\ttfamily size\+\_\+t\& Update\+Interval (\begin{DoxyParamCaption}{ }\end{DoxyParamCaption})\hspace{0.3cm}{\ttfamily [inline]}} Modify the update interval. Definition at line 60 of file training\+\_\+config.\+hpp. The documentation for this class was generated from the following file\+:\begin{DoxyCompactItemize} \item /var/www/mlpack.\+ratml.\+org/mlpack.\+org/\+\_\+src/mlpack-\/3.\+3.\+1/src/mlpack/methods/reinforcement\+\_\+learning/\textbf{ training\+\_\+config.\+hpp}\end{DoxyCompactItemize}