Infrastructure deterioration modeling with an inhomogeneous continuous time Markov chain: A latent state approach with analytic transition probabilities.
Daijiro MizutaniXian-Xun YuanPublished in: Comput. Aided Civ. Infrastructure Eng. (2023)
Keyphrases
- markov chain
- transition probabilities
- steady state
- state space
- random walk
- markov process
- monte carlo
- markov model
- stationary distribution
- stochastic process
- monte carlo method
- monte carlo simulation
- markov decision process
- transition matrix
- queue length
- latent variables
- reward function
- markov models
- parameter estimation
- reinforcement learning