BLMDP: A new bi-level Markov decision process approach to joint bidding andtask-scheduling in cloud spot market.
Mona NaghdehforoushhaMehdi Dehghan Takht FooladiMohammad Hossein RezvaniMohammad Mehdi Gilanian SadeghiPublished in: Turkish J. Electr. Eng. Comput. Sci. (2022)
Keyphrases
- bi level
- markov decision process
- state space
- markov decision processes
- spot market
- optimal policy
- gray scale
- reinforcement learning
- finite horizon
- infinite horizon
- resource allocation
- policy iteration
- combinatorial auctions
- initial state
- transition probabilities
- machine learning
- online auctions
- decision problems
- multiresolution
- gray level
- sufficient conditions
- markov chain
- learning algorithm
- inventory models
- dynamic programming