Login / Signup

Basis Markov Partitions and Transition Matrices for Stochastic Systems.

Erik M. BolltPawel GóraAndrzej OstruszkaKarol Zyczkowski
Published in: SIAM J. Appl. Dyn. Syst. (2008)
Keyphrases
  • stochastic systems
  • transition matrices
  • markov decision processes
  • stochastic models
  • markov chain
  • confidence intervals
  • markov model
  • sample path
  • dynamic programming
  • random walk
  • fixed point
  • markov decision problems