Constrained Markov control processes with randomized discounted cost criteria: Occupation measures and extremal points

Juan González-Hernández, Raquiel R. López-Martínez, J. Adolfo Minjárez-Sosa*, J. Rigoberto Gabriel-Arguelles

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

8 Scopus citations

Abstract

In this paper we study constrained Markov control processes on Borel spaces with possibly unbounded costs, under a discounted optimality criterion with random discount factor and restrictions of the same kind. Imposing mild conditions, we show the solubility of the corresponding control problem. Furthermore, we characterize the corresponding occupation measures and show the existence of randomized optimal control policies. These optimal strategies are convex combinations of deterministic stationary policies.

Original languageEnglish
Pages (from-to)163-176
Number of pages14
JournalRisk and Decision Analysis
Volume4
Issue number3
DOIs
StatePublished - 2013

Keywords

  • Constrained discounted cost
  • direct method
  • occupation measures
  • random discount factor

Fingerprint

Dive into the research topics of 'Constrained Markov control processes with randomized discounted cost criteria: Occupation measures and extremal points'. Together they form a unique fingerprint.

Cite this