Xianping Guo

Publication Activity (10 Years)

Years Active: 1999-2023
Publications (10 Years): 24

Top Topics

Markov Decision Process

Stationary Policies

Discount Factor

Top Venues

IEEE Trans. Autom. Control.

Discret. Event Dyn. Syst.

J. Optim. Theory Appl.

Oper. Res. Lett.

Publications

Li Xia, Xianping Guo, Xi-Ren Cao
A note on the existence of optimal stationary policies for average Markov decision processes with countable states. Autom. 151 (2023)
Yonghui Huang, Zhaotong Lian, Xianping Guo
Zero-sum infinite-horizon discounted piecewise deterministic Markov games. Math. Methods Oper. Res. 97 (2) (2023)
Xiangxiang Huang, Xianping Guo, Xin Wen
Zero-Sum Games for Finite-Horizon Semi-Markov Processes Under the Probability Criterion. IEEE Trans. Autom. Control. 68 (9) (2023)
Zhihui Yu, Xianping Guo, Li Xia
Zero-sum semi-Markov games with state-action-dependent discount factors. Discret. Event Dyn. Syst. 32 (4) (2022)
Yonghui Huang, Zhaotong Lian, Xianping Guo
Risk-sensitive infinite-horizon discounted piecewise deterministic Markov decision processes. Oper. Res. 22 (5) (2022)
Fang Chen, Xianping Guo, Zhong-Wei Liao
Optimal Stopping Time on Semi-Markov Processes with Finite Horizon. J. Optim. Theory Appl. 194 (2) (2022)
Junyu Zhang, Xianping Guo, Li Xia
Zero-sum risk-sensitive continuous-time stochastic games with unbounded payoff and transition rates and Borel spaces. CoRR (2021)
Zhihui Yu, Xianping Guo, Li Xia
Zero-Sum Semi-Markov Games with State-Action-Dependent Discount Factors. CoRR (2021)
Xiangxiang Huang, Xianping Guo
Nonzero-Sum Stochastic Games with Probability Criteria. Dyn. Games Appl. 10 (2) (2020)
Yonghui Huang, Xianping Guo
Multiconstrained Finite-Horizon Piecewise Deterministic Markov Decision Processes with Unbounded Transition Rates. Math. Oper. Res. 45 (2) (2020)
Haifeng Huo, Xianping Guo
Risk Probability Minimization Problems for Continuous-Time Markov Decision Processes on Finite Horizon. IEEE Trans. Autom. Control. 65 (7) (2020)
Yonghui Huang, Zhaotong Lian, Xianping Guo
Risk-sensitive finite-horizon piecewise deterministic Markov decision processes. Oper. Res. Lett. 48 (1) (2020)
Xiangxiang Huang, Qiuli Liu, Xianping Guo
$N$-Person Nonzero-Sum Games for Continuous-Time Jump Processes With Varying Discount Factors. IEEE Trans. Autom. Control. 64 (5) (2019)
Zhongyang Sun, Xianping Guo
Equilibrium for a Time-Inconsistent Stochastic Linear-Quadratic Control System with Jumps and Its Application to the Mean-Variance Problem. J. Optim. Theory Appl. 181 (2) (2019)
Xianping Guo, Junyu Zhang
Risk-sensitive continuous-time Markov decision processes with unbounded rates and Borel spaces. Discret. Event Dyn. Syst. 29 (4) (2019)
Xianping Guo, Zhong-Wei Liao
Risk-Sensitive Discounted Continuous-Time Markov Decision Processes with Unbounded Rates. SIAM J. Control. Optim. 57 (6) (2019)
Xianggang Lu, George Yin, Xianping Guo
Infinite Horizon Controlled Diffusions with Randomly Varying and State-Dependent Discount Cost Rates. J. Optim. Theory Appl. 172 (2) (2017)
Haifeng Huo, Xiaolong Zou, Xianping Guo
The risk probability criterion for discounted continuous-time Markov decision processes. Discret. Event Dyn. Syst. 27 (4) (2017)
Yonghui Huang, Xianping Guo
Minimum Average Value-at-Risk for Finite Horizon Semi-Markov Decision Processes in Continuous Time. SIAM J. Optim. 26 (1) (2016)
Xianping Guo, Yi Zhang
Optimality of Mixed Policies for Average Continuous-Time Markov Decision Processes with Constraints. Math. Oper. Res. 41 (4) (2016)
Xiaolong Zou, Xianping Guo
Another set of verifiable conditions for average Markov decision processes with Borel spaces. Kybernetika 51 (2) (2015)
Xianping Guo, Xiangxiang Huang, Yi Zhang
On the First Passage g-Mean-Variance Optimality for Discounted Continuous-Time Markov Decision Processes. SIAM J. Control. Optim. 53 (3) (2015)
Xiao Wu, Xianping Guo
First Passage Optimality and Variance Minimisation of Markov Decision Processes with Varying Discount Factors. J. Appl. Probab. 52 (2) (2015)
Qingda Wei, Xianping Guo
Semi-Markov decision processes with variance minimization criterion. 4OR 13 (1) (2015)
Jun Tan, Xianping Guo, Wei-Shi Zheng, Ming Zhong
Case-based teaching using the Laboratory Animal System for learning C/C++ programming. Comput. Educ. 77 (2014)
Quanxin Zhu, Xianping Guo
-discount and finite-horizon optimality for continuous-time Markov decision processes. J. Syst. Sci. Complex. 27 (5) (2014)
Xianping Guo, Wenzhao Zhang
Convergence of controlled models and finite-state approximation for discounted continuous-time Markov decision processes with constraints. Eur. J. Oper. Res. 238 (2) (2014)
Yonghui Huang, Zhongfei Li, Xianping Guo
Constrained optimality for finite horizon semi-Markov decision processes in Polish spaces. Oper. Res. Lett. 42 (2) (2014)
Xianping Guo, XinYuan Song, Yi Zhang
First Passage Optimality for Continuous-Time Markov Decision Processes With Varying Discount Factors and History-Dependent Policies. IEEE Trans. Autom. Control. 59 (1) (2014)
Yonghui Huang, Qingda Wei, Xianping Guo
Constrained Markov decision processes with first passage criteria. Ann. Oper. Res. 206 (1) (2013)
Xianping Guo, Adrián Hernández-del-Valle, Onésimo Hernández-Lerma
First Passage Problems for Nonstationary Discrete-Time Stochastic Control Systems. Eur. J. Control 18 (6) (2012)
Xianping Guo, Yonghui Huang, XinYuan Song
Linear Programming and Constrained Average Optimality for General Continuous-Time Markov Decision Processes in History-Dependent Policies. SIAM J. Control. Optim. 50 (1) (2012)
Xianping Guo, Liuer Ye, George Yin
A mean-variance optimization problem for discounted Markov decision processes. Eur. J. Oper. Res. 220 (2) (2012)
Qiuli Liu, HangSheng Tan, Xianping Guo
Denumerable continuous-time Markov decision processes with multiconstraints on average costs. Int. J. Syst. Sci. 43 (3) (2012)
Qingda Wei, Xianping Guo
New Average Optimality Conditions for Semi-Markov Decision Processes in Borel Spaces. J. Optim. Theory Appl. 153 (3) (2012)
Jianxiong Cai, Yuanqi Zhao, Xianping Guo, Min Zhao, Yubo Lu, Ruizhi Zhao, Yefeng Cai, Darong Wu
Application of Conditional Logistic Regression method in a prospective effectiveness comparative study among patients with Acute Ischemic Stroke. BIBM Workshops (2011)
Xianping Guo, Alexei B. Piunovskiy
Discounted Continuous-Time Markov Decision Processes with Constraints: Unbounded Transition and Loss Rates. Math. Oper. Res. 36 (1) (2011)
Qingda Wei, Xianping Guo
Markov decision processes with state-dependent discount factors and unbounded rewards/costs. Oper. Res. Lett. 39 (5) (2011)
Yonghui Huang, Xianping Guo
Finite horizon semi-Markov decision processes with application to maintenance systems. Eur. J. Oper. Res. 212 (1) (2011)
Yonghui Huang, Xianping Guo, XinYuan Song
Performance Analysis for Controlled Semi-Markov Systems with Application to Maintenance. J. Optim. Theory Appl. 150 (2) (2011)
Xianping Guo, Adrián Hernández-del-Valle, Onésimo Hernández-Lerma
Nonstationary discrete-time deterministic and stochastic control systems: Bounded and unbounded cases. Syst. Control. Lett. 60 (7) (2011)
Xianping Guo, Lanlan Zhang
Total reward criteria for unconstrained/constrained continuous-time Markov decision processes. J. Syst. Sci. Complex. 24 (3) (2011)
Liuer Ye, Xianping Guo
New sufficient conditions for average optimality in continuous-time Markov decision processes. Math. Methods Oper. Res. 72 (1) (2010)
Xianping Guo, Adrián Hernández-del-Valle, Onésimo Hernández-Lerma
Nonstationary discrete-time deterministic and stochastic control systems with infinite horizon. Int. J. Control 83 (9) (2010)
Xianping Guo, XinYuan Song
Mean-Variance Criteria for Finite Continuous-Time Markov Decision Processes. IEEE Trans. Autom. Control. 54 (9) (2009)
Xianping Guo, XinYuan Song, Junyu Zhang
Bias optimality for multichain continuous-time Markov decision processes. Oper. Res. Lett. 37 (5) (2009)
Lanlan Zhang, Xianping Guo
Constrained continuous-time Markov decision processes with average criteria. Math. Methods Oper. Res. 67 (2) (2008)
Xianping Guo
Continuous-Time Markov Decision Processes with Discounted Rewards: The Case of Polish Spaces. Math. Oper. Res. 32 (1) (2007)
Xi-Ren Cao, Xianping Guo
Partially Observable Markov Decision Processes With Reward Information: Basic Ideas and Models. IEEE Trans. Autom. Control. 52 (4) (2007)
Xianping Guo
Constrained Optimization for Average Cost Continuous-Time Markov Decision Processes. IEEE Trans. Autom. Control. 52 (6) (2007)
Quanxin Zhu, Xianping Guo, Yonglong Dai
Unbounded cost Markov decision processes with limsup and liminf average criteria: new conditions. Math. Methods Oper. Res. 61 (3) (2005)
Xianping Guo, Xi-Ren Cao
Optimal Control of Ergodic Continuous-Time Markov Chains with Average Sample-Path Rewards. SIAM J. Control. Optim. 44 (1) (2005)
Xi-Ren Cao, Xianping Guo
Partially observable Markov decision processes with reward information. CDC (2004)
Xi-Ren Cao, Xianping Guo
A unified approach to Markov decision problems and performance sensitivity analysis with discounted and average criteria: multichain cases. Autom. 40 (10) (2004)
Xianping Guo, Onésimo Hernández-Lerma
Drift and monotonicity conditions for continuous-time controlled Markov chains with an average criterion. IEEE Trans. Autom. Control. 48 (2) (2003)
Xianping Guo, Wen Yu, Xiaoou Li
Minimax control for discrete-time time-varying stochastic systems. Autom. 38 (11) (2002)
Xianping Guo, Peng Shi
Limiting Average Criteria For Nonstationary Markov Decision Processes. SIAM J. Optim. 11 (4) (2001)
Xianping Guo, Ke Liu
A note on optimality conditions for continuous-time Markov decision processes with average cost criterion. IEEE Trans. Autom. Control. 46 (12) (2001)
Xianping Guo, Jianyong Liu, Ke Liu
Nonhomogeneous Markov Decision Processes with Borel State Space-The Average Criterion with Nonuniformly Bounded Rewards. Math. Oper. Res. 25 (4) (2000)
Xianping Guo, Peng Shi, Weiping Zhu
A new strong optimality criterion for nonstationary Markov decision processes. Math. Methods Oper. Res. 52 (2) (2000)
Xianping Guo
Nonstationary denumerable state Markov decision processes - with average variance criterion. Math. Methods Oper. Res. 49 (1) (1999)