Description: Markov decision process value iteration algorithm value iteration, policy iteration and so the function code, from the foreign website, very detailed and useful.
File list (Check if you may need any files):
MDPtoolbox
..........\AUTHORS
..........\COPYING
..........\README
..........\documentation
..........\.............\BIA.png
..........\.............\DOCUMENTATION.html
..........\.............\INRA.png
..........\.............\arrow.gif
..........\.............\index_alphabetic.html
..........\.............\index_category.html
..........\.............\mdp_LP.html
..........\.............\mdp_Q_learning.html
..........\.............\mdp_bellman_operator.html
..........\.............\mdp_check.html
..........\.............\mdp_check_square_stochastic.html
..........\.............\mdp_computePR.html
..........\.............\mdp_computePpolicyPRpolicy.html
..........\.............\mdp_eval_policy_TD_0.html
..........\.............\mdp_eval_policy_iterative.html
..........\.............\mdp_eval_policy_matrix.html
..........\.............\mdp_eval_policy_optimality.html
..........\.............\mdp_example_forest.html
..........\.............\mdp_example_rand.html
..........\.............\mdp_finite_horizon.html
..........\.............\mdp_policy_iteration.html
..........\.............\mdp_policy_iteration_modified.html
..........\.............\mdp_relative_value_iteration.html
..........\.............\mdp_span.html
..........\.............\mdp_value_iteration.html
..........\.............\mdp_value_iterationGS.html
..........\.............\mdp_value_iteration_bound_iter.html
..........\.............\mdp_verbose_silent.html
..........\.............\meandiscrepancy.jpg
..........\mdp_LP.m
..........\mdp_Q_learning.m
..........\mdp_bellman_operator.m
..........\mdp_check.m
..........\mdp_check_square_stochastic.m
..........\mdp_computePR.m
..........\mdp_computePpolicyPRpolicy.m
..........\mdp_eval_policy_TD_0.m
..........\mdp_eval_policy_iterative.m
..........\mdp_eval_policy_matrix.m
..........\mdp_eval_policy_optimality.m
..........\mdp_example_forest.m
..........\mdp_example_rand.m
..........\mdp_finite_horizon.m
..........\mdp_policy_iteration.m
..........\mdp_policy_iteration_modified.m
..........\mdp_relative_value_iteration.m
..........\mdp_silent.m
..........\mdp_span.m
..........\mdp_value_iteration.m
..........\mdp_value_iterationGS.m
..........\mdp_value_iteration_bound_iter.m
..........\mdp_verbose.m
license.txt