Algorithms for discounted stochastic games

S. S. Rao, R. Chandrasekaran, K. P.K. Nair

Research output: Contribution to journalArticlepeer-review

24 Scopus citations


In this paper, a two-person zero-sum discounted stochastic game with a finite state space is considered. The movement of the game from state to state is jointly controlled by the two players with a finite number of alternatives available to each player in each of the states. We present two convergent algorithms for arriving at minimax strategies for the players and the value of the game. The two algorithms are compared with respect to computational efficiency. Finally, a possible extension to nonzero sum stochastic game is suggested.

Original languageEnglish (US)
Pages (from-to)627-637
Number of pages11
JournalJournal of Optimization Theory and Applications
Issue number6
StatePublished - Nov 1 1973
Externally publishedYes

ASJC Scopus subject areas

  • Control and Optimization
  • Management Science and Operations Research
  • Applied Mathematics


Dive into the research topics of 'Algorithms for discounted stochastic games'. Together they form a unique fingerprint.

Cite this