Abstract
In this paper we develop the theory of Markov chains with stationary transition probabilities, where the transition probabilities and the initial distribution are assumed only to be finitely additive. We prove a strong law of large numbers for recurrent chains. The problem of existence and uniqueness of finitely additive stationary initial distributions is studied and the ergodicity of recurrent chains under a stationary initial distribution is proved.
Original language | English (US) |
---|---|
Pages (from-to) | 247-272 |
Number of pages | 26 |
Journal | Transactions of the American Mathematical Society |
Volume | 265 |
Issue number | 1 |
DOIs | |
State | Published - May 1981 |
Keywords
- Finitely additive probabilities
- Markov chain
- Markov strategy
- Stationary initial distribution
- Stationary transition
- Strategy
ASJC Scopus subject areas
- Mathematics(all)
- Applied Mathematics