Time and Ratio Expected Average Cost Optimality for Semi-Markov Control Processes on Borel Spaces

Fernando Luque-Vásquez*, Oscar Vega-Amaya

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

We deal with semi-Markov control models with Borel state and control spaces, and unbounded cost functions under the ratio and the time expected average cost criteria. Under suitable growth conditions on the costs and the mean holding times together with stability conditions on the embedded Markov chains, we show the following facts: (i) the ratio and the time average costs coincide in the class of the stationary policies; (ii) there exists a stationary policy which is optimal for both criteria. Moreover, we provide a generalization of the classical Wald's Lemma to semi-Markov processes. These results are obtained combining the existence of solutions of the average cost optimality equation and the Optional Stopping Theorem.

Original languageEnglish
Pages (from-to)715-734
Number of pages20
JournalCommunications in Statistics - Theory and Methods
Volume33
Issue number3
DOIs
StatePublished - Mar 2004

Keywords

  • Average cost criteria
  • Optional stopping theorem
  • Semi-Markov control processes

Fingerprint

Dive into the research topics of 'Time and Ratio Expected Average Cost Optimality for Semi-Markov Control Processes on Borel Spaces'. Together they form a unique fingerprint.

Cite this