Matrix Measures and Random Walks with a Block Tridiagonal Transition Matrix.
Holger DetteBettina ReutherW. J. StuddenMarcin J. ZygmuntPublished in: SIAM J. Matrix Anal. Appl. (2006)
Keyphrases
- transition matrix
- random walk
- markov chain
- directed graph
- transition probabilities
- finite state
- stationary distribution
- proximity measures
- state space
- markov model
- transition probability matrix
- link prediction
- linear systems
- markov decision process
- markov random walk
- spectral methods
- flow graph
- reinforcement learning