Missing Mass of Markov Chains.
Prafulla ChandraAndrew ThangarajNived RajaramanPublished in: ISIT (2020)
Keyphrases
- markov chain
- steady state
- markov process
- markov model
- transition probabilities
- missing data
- monte carlo
- random walk
- monte carlo method
- stationary distribution
- monte carlo simulation
- finite state
- stochastic process
- transition matrix
- sample path
- incomplete data
- state space
- missing values
- probabilistic automata
- markov processes
- machine learning
- algo rithm
- queue length
- reinforcement learning