MDPtoolbox: Markov Decision Processes Toolbox

The Markov Decision Processes (MDP) toolbox proposes functions related to the resolution of discrete-time Markov Decision Processes: finite horizon, value iteration, policy iteration, linear programming algorithms with some variants and also proposes some functions related to Reinforcement Learning.

Version: 4.0.3
Depends: Matrix, linprog
Published: 2017-03-03
DOI: 10.32614/CRAN.package.MDPtoolbox
Author: Iadine Chades, Guillaume Chapron, Marie-Josee Cros, Frederick Garcia, Regis Sabbadin
Maintainer: Guillaume Chapron <gchapron at>
License: BSD_3_clause + file LICENSE
NeedsCompilation: no
CRAN checks: MDPtoolbox results


Reference manual: MDPtoolbox.pdf


Package source: MDPtoolbox_4.0.3.tar.gz
Windows binaries: r-devel:, r-release:, r-oldrel:
macOS binaries: r-release (arm64): MDPtoolbox_4.0.3.tgz, r-oldrel (arm64): MDPtoolbox_4.0.3.tgz, r-release (x86_64): MDPtoolbox_4.0.3.tgz, r-oldrel (x86_64): MDPtoolbox_4.0.3.tgz
Old sources: MDPtoolbox archive


Please use the canonical form to link to this page.