Concentration Bounds for Co-occurrence Matrices of Markov Chains.
Jiezhong QiuChi WangBen LiaoRichard PengJie TangPublished in: CoRR (2020)
Keyphrases
- markov chain
- steady state
- transition probabilities
- upper bound
- finite state
- markov process
- monte carlo
- markov model
- random walk
- state space
- monte carlo method
- stochastic process
- texture analysis
- stationary distribution
- probabilistic automata
- markov processes
- monte carlo simulation
- gray level
- worst case
- transition matrix
- assemble to order systems
- variance reduction
- confidence intervals
- model checking
- search space