Robotic surveillance and Markov chains with minimal first passage time.
Pushkarini AgharkarRushabh PatelFrancesco BulloPublished in: CDC (2014)
Keyphrases
- markov chain
- stochastic process
- steady state
- finite state
- transition probabilities
- markov process
- monte carlo
- state space
- stationary distribution
- monte carlo method
- mobile robot
- transition matrix
- markov processes
- markov model
- monte carlo simulation
- random walk
- robotic systems
- sample path
- confidence intervals
- non stationary
- reinforcement learning