Alexei B. Piunovskiy

Publication Activity (10 Years)

Years Active: 2000-2024
Publications (10 Years): 6

Top Topics

Markov Decision Process

Hard Constraints

Infinite Horizon

Top Venues

Int. J. Control

SIAM J. Control. Optim.

J. Appl. Probab.

Publications

Alexei B. Piunovskiy, Yi Zhang
Extreme Occupation Measures in Markov Decision Processes with an Absorbing State. SIAM J. Control. Optim. 62 (1) (2024)
François Dufour, Alexei B. Piunovskiy, Alexander Plakhov
On the equivalence of the integral and differential Bellman equations in impulse control problems. Int. J. Control 95 (1) (2022)
Konstantin Avrachenkov, Alexei B. Piunovskiy, Yi Zhang
Impulsive Control for G-AIMD Dynamics with Relaxed and Hard Constraints. CoRR (2018)
Konstantin Avrachenkov, Alexei B. Piunovskiy, Yi Zhang
Impulsive Control for G-AIMD Dynamics with Relaxed and Hard Constraints. CDC (2018)
Xin Guo, Alexei B. Piunovskiy, Yi Zhang
Note on discounted continuous-time Markov decision processes with a lower bounding function. J. Appl. Probab. 54 (4) (2017)
Oswaldo L. V. Costa, François Dufour, Alexei B. Piunovskiy
Constrained and Unconstrained Optimal Discounted Control of Piecewise Deterministic Markov Processes. SIAM J. Control. Optim. 54 (3) (2016)
Konstantin Avrachenkov, Alexei B. Piunovskiy, Yi Zhang
Hitting with Restart: A Reason for Sisyphus Labour. CoRR (2015)
Konstantin Avrachenkov, Oussama Habachi, Alexei B. Piunovskiy, Yi Zhang
Infinite horizon optimal impulsive control with applications to Internet congestion control. Int. J. Control 88 (4) (2015)
Konstantin Avrachenkov, Oussama Habachi, Alexei B. Piunovskiy, Yi Zhang
Infinite Horizon Optimal Impulsive Control Theory with Application to Internet Congestion Control. CoRR (2013)
Konstantin Avrachenkov, Alexei B. Piunovskiy, Yi Zhang
Markov Processes with Restart CoRR (2012)
Xianping Guo, Alexei B. Piunovskiy
Discounted Continuous-Time Markov Decision Processes with Constraints: Unbounded Transition and Loss Rates. Math. Oper. Res. 36 (1) (2011)
Yi Zhang, Alexei B. Piunovskiy, Urtzi Ayesta, Konstantin Avrachenkov
Convergence of trajectories and optimal buffer sizing for MIMD congestion control. Comput. Commun. 33 (2) (2010)
Konstantin Avrachenkov, Urtzi Ayesta, Alexei B. Piunovskiy
Convergence of trajectories and optimal buffer sizing for AIMD congestion control. Perform. Evaluation 67 (7) (2010)
Alexei B. Piunovskiy
Random walk, birth-and-death process and their fluid approximations: absorbing case. Math. Methods Oper. Res. 70 (2) (2009)
Konstantin Avrachenkov, Urtzi Ayesta, Alexei B. Piunovskiy
Convergence and Optimal Buffer Sizing for Window Based AIMD Congestion Control CoRR (2007)
Damian Clancy, Alexei B. Piunovskiy
An explicit optimal isolation policy for a deterministic epidemic model. Appl. Math. Comput. 163 (3) (2005)
Konstantin Avrachenkov, Urtzi Ayesta, Alexei B. Piunovskiy
Optimal choice of the buffer size in the Internet routers. CDC/ECC (2005)
Alexei B. Piunovskiy
Optimal Interventions in Countable Jump Markov Processes. Math. Oper. Res. 29 (2) (2004)
Alexei B. Piunovskiy
Multicriteria impulsive control of jump Markov processes. Math. Methods Oper. Res. 60 (1) (2004)
Alexei B. Piunovskiy
Bicriteria Optimization of a Queue with a Controlled Input Stream. Queueing Syst. Theory Appl. 48 (1-2) (2004)
Pierre-Alexandre Bliman, Alexei B. Piunovskiy, Michel Sorine
Controlled linear system with delayed relay output under impulse random disturbances. Autom. 39 (8) (2003)
Eugene A. Feinberg, Alexei B. Piunovskiy
Nonatomic total rewards Markov decision processes with multiple criteria. CDC (2000)
Alexei B. Piunovskiy, Xuerong Mao
Constrained Markovian decision processes: the dynamic programming approach. Oper. Res. Lett. 27 (3) (2000)