The existence of good Markov strategies for decision processes with general payoffs

Theodore P. Hill; Victor C. Pestien

doi:10.1016/0304-4149(87)90028-7

The existence of good Markov strategies for decision processes with general payoffs

Theodore P. Hill, Victor C. Pestien

Mathematics

Research output: Contribution to journal › Article › peer-review

8 Scopus citations

Abstract

For countable-state decision processes (dynamic programming problems), a general class of objective functions is identified for which it is shown that good Markov strategies always exist. This class includes product and lim inf rewards, as well as practically all the classical dynamic programming expected payoff functions.

Original language	English (US)
Pages (from-to)	61-76
Number of pages	16
Journal	Stochastic Processes and their Applications
Volume	24
Issue number	1
DOIs	https://doi.org/10.1016/0304-4149(87)90028-7
State	Published - Feb 1987

Keywords

Markov decision process
Markov strategy
dynamic programming

ASJC Scopus subject areas

Statistics and Probability
Modeling and Simulation
Applied Mathematics

Access to Document

10.1016/0304-4149(87)90028-7

Fingerprint Dive into the research topics of 'The existence of good Markov strategies for decision processes with general payoffs'. Together they form a unique fingerprint.

Cite this

@article{da6ecad4bf2d452291a1bd2444ef4f6a,

title = "The existence of good Markov strategies for decision processes with general payoffs",

abstract = "For countable-state decision processes (dynamic programming problems), a general class of objective functions is identified for which it is shown that good Markov strategies always exist. This class includes product and lim inf rewards, as well as practically all the classical dynamic programming expected payoff functions.",

keywords = "Markov decision process, Markov strategy, dynamic programming",

author = "Hill, {Theodore P.} and Pestien, {Victor C.}",

year = "1987",

month = feb,

doi = "10.1016/0304-4149(87)90028-7",

language = "English (US)",

volume = "24",

pages = "61--76",

journal = "Stochastic Processes and their Applications",

issn = "0304-4149",

publisher = "Elsevier",

number = "1",

}

TY - JOUR

T1 - The existence of good Markov strategies for decision processes with general payoffs

AU - Hill, Theodore P.

AU - Pestien, Victor C.

PY - 1987/2

Y1 - 1987/2

N2 - For countable-state decision processes (dynamic programming problems), a general class of objective functions is identified for which it is shown that good Markov strategies always exist. This class includes product and lim inf rewards, as well as practically all the classical dynamic programming expected payoff functions.

AB - For countable-state decision processes (dynamic programming problems), a general class of objective functions is identified for which it is shown that good Markov strategies always exist. This class includes product and lim inf rewards, as well as practically all the classical dynamic programming expected payoff functions.

KW - Markov decision process

KW - Markov strategy

KW - dynamic programming

UR - http://www.scopus.com/inward/record.url?scp=38249036444&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=38249036444&partnerID=8YFLogxK

U2 - 10.1016/0304-4149(87)90028-7

DO - 10.1016/0304-4149(87)90028-7

M3 - Article

AN - SCOPUS:38249036444

VL - 24

SP - 61

EP - 76

JO - Stochastic Processes and their Applications

JF - Stochastic Processes and their Applications

SN - 0304-4149

IS - 1

ER -