TY - GEN
T1 - Approximation of lorenz-optimal solutions in multiobjective Markov decision processes
AU - Perny, Patrice
AU - Weng, Paul
AU - Goldsmith, Judy
AU - Hanna, Josiah P.
PY - 2013
Y1 - 2013
N2 - This paper is devoted to fair optimization in Multiobjective Markov Decision Processes (MOMDPs). A MOMDP is an extension of the MDP model for planning under uncertainty while trying to optimize several reward functions simultaneously. This applies to multiagent problems when rewards define individual utility functions, or in multicriteria problems when rewards refer to different features. In this setting, we study the determination of policies leading to Lorenz-non-dominated tradeoffs. Lorenz dominance is a refinement of Pareto dominance that was introduced in Social Choice for the measurement of inequalities. In this paper, we introduce methods to efficiently approximate the sets of Lorenz-non-dominated solutions of infinite-horizon, discounted MOMDPs. The approximations are polynomial-sized subsets of those solutions.
AB - This paper is devoted to fair optimization in Multiobjective Markov Decision Processes (MOMDPs). A MOMDP is an extension of the MDP model for planning under uncertainty while trying to optimize several reward functions simultaneously. This applies to multiagent problems when rewards define individual utility functions, or in multicriteria problems when rewards refer to different features. In this setting, we study the determination of policies leading to Lorenz-non-dominated tradeoffs. Lorenz dominance is a refinement of Pareto dominance that was introduced in Social Choice for the measurement of inequalities. In this paper, we introduce methods to efficiently approximate the sets of Lorenz-non-dominated solutions of infinite-horizon, discounted MOMDPs. The approximations are polynomial-sized subsets of those solutions.
UR - https://www.scopus.com/pages/publications/84888161425
UR - https://www.scopus.com/inward/citedby.url?scp=84888161425&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:84888161425
T3 - Uncertainty in Artificial Intelligence - Proceedings of the 29th Conference, UAI 2013
SP - 508
EP - 517
BT - Uncertainty in Artificial Intelligence - Proceedings of the 29th Conference, UAI 2013
T2 - 29th Conference on Uncertainty in Artificial Intelligence, UAI 2013
Y2 - 11 July 2013 through 15 July 2013
ER -