Vivek S. Borkar

ORCID

Publication Activity (10 Years)

Years Active: 1991-2024
Publications (10 Years): 107

Top Venues

CoRR

CDC

SIAM J. Control. Optim.

Syst. Control. Lett.

Publications

Francisco Robledo Relaño, Vivek S. Borkar, Urtzi Ayesta, Konstantin Avrachenkov
Tabular and Deep Learning for the Whittle Index. CoRR (2024)
Siddharth Chandak, Pratik Shah, Vivek S. Borkar, Parth Dodhia
Reinforcement learning in non-Markovian environments. Syst. Control. Lett. 185 (2024)
Mandar R. Nalavade, Gaurav S. Kasbekar, Vivek S. Borkar
Whittle Index Based User Association in Dense Millimeter Wave Networks. CoRR (2024)
Vivek S. Borkar, Prashant G. Mehta, Guodong Pang, Serdar Yüksel
Stochastic control and stability with applications: Ari Arapostathis memorial issue. Syst. Control. Lett. 174 (2023)
Siddharth Chandak, Vivek S. Borkar
A Concentration Bound for TD(0) with Function Approximation. CoRR (2023)
Tejas Pagare, Vivek S. Borkar, Konstantin Avrachenkov
Full Gradient Deep Reinforcement Learning for Average-Reward Criterion. L4DC (2023)
Siddharth Chandak, Vivek S. Borkar, Harsh Dolhare
A concentration bound for LSPE(λ). Syst. Control. Lett. 171 (2023)
Siva Athreya, Vivek S. Borkar, Nitya Gadhiwala
Controlled Martingale Problems And Their Markov Mimics. CoRR (2023)
Konstantin Avrachenkov, Vivek S. Borkar, U. Jayakrishnan Nair
Special Issue : Multi-Agent Dynamic Decision Making and Learning. Dyn. Games Appl. 13 (1) (2023)
Sai Sumedh R. Hindupur, Vivek S. Borkar
Online Parameter Estimation in Partially Observed Markov Decision Processes. Allerton (2023)
Shalabh Bhatnagar, Vivek S. Borkar, Soumyajit Guin
Actor-Critic or Critic-Actor? A Tale of Two Time Scales. IEEE Control. Syst. Lett. 7 (2023)
Anup Biswas, Vivek S. Borkar
Ergodic risk-sensitive control - A survey. Annu. Rev. Control. 55 (2023)
Tejas Pagare, Vivek S. Borkar, Konstantin Avrachenkov
Full Gradient Deep Reinforcement Learning for Average-Reward Criterion. CoRR (2023)
Keshav P. Keval, Vivek S. Borkar
Decentralised Q-Learning for Multi-Agent Markov Decision Processes with a Satisfiability Criterion. CoRR (2023)
Pranav S. Page, Anand S. Siyote, Vivek S. Borkar, Gaurav S. Kasbekar
Node Cardinality Estimation in the Internet of Things Using Privileged Feature Distillation. CoRR (2023)
Vivek S. Borkar, Adit Akarsh
Approximation of Convex Envelope Using Reinforcement Learning. CoRR (2023)
Karthik G. V. B., Vivek S. Borkar, Gaurav S. Kasbekar
Scheduling in Wireless Networks using Whittle Index Theory. CoRR (2022)
Francisco Robledo, Vivek S. Borkar, Urtzi Ayesta, Konstantin Avrachenkov
QWI: Q-learning with Whittle Index. SIGMETRICS Perform. Evaluation Rev. 49 (2) (2022)
Vivek S. Borkar, Sarath Pattathil
Whittle indexability in egalitarian processor sharing systems. Ann. Oper. Res. 317 (2) (2022)
Konstantin E. Avrachenkov, Vivek S. Borkar
Whittle index based Q-learning for restless bandits with average reward. Autom. 139 (2022)
Vivek S. Borkar
Corrigendum to "A concentration bound for contractive stochastic approximation" [Syst. Control Lett. 153 (2021) 104947]. Syst. Control. Lett. 159 (2022)
Siddharth Chandak, Vivek S. Borkar, Parth Dodhia
Reinforcement Learning in Non-Markovian Environments. CoRR (2022)
Harsh Dolhare, Vivek S. Borkar
A Concentration Bound for Distributed Stochastic Approximation. Allerton (2022)
Vivek S. Borkar, Alexandre Reiffers-Masson
Opinion Shaping in Social Networks Using Reinforcement Learning. IEEE Trans. Control. Netw. Syst. 9 (3) (2022)
Karthik G. V. B., Vivek S. Borkar, Gaurav S. Kasbekar
Scheduling in Wireless Networks using Whittle Index Theory. NCC (2022)
Vivek S. Borkar, Vladimir Gaitsgory, Ilya Shvartsman
ERRATUM: LP Formulations of Discrete Time Long-Run Average Optimal Control Problems: The Nonergodic Case. SIAM J. Control. Optim. 60 (2) (2022)
Santosh Kumar Singh, Vivek S. Borkar, Gaurav S. Kasbekar
User Association in Dense mmWave Networks as Restless Bandits. IEEE Trans. Veh. Technol. 71 (7) (2022)
Shaan Ul Haque, Vivek S. Borkar
Concentration bounds for SSP Q-learning for average cost MDPs. CoRR (2022)
Harsh Dolhare, Vivek S. Borkar
A Concentration Bound for Distributed Stochastic Approximation. CoRR (2022)
Vivek S. Borkar, D. Manjunath
Revisiting SIR in the Age of COVID-19: Explicit Solutions and Control Problems. SIAM J. Control. Optim. 60 (2) (2022)
Shalabh Bhatnagar, Vivek S. Borkar, Soumyajit Guin
Actor-Critic or Critic-Actor? A Tale of Two Time Scales. CoRR (2022)
Arghyadip Roy, Vivek S. Borkar, Abhay Karandikar, Prasanna Chaporkar
Online Reinforcement Learning of Optimal Threshold Policies for Markov Decision Processes. IEEE Trans. Autom. Control. 67 (7) (2022)
Vivek S. Borkar
Learning to cooperate in agent-based control of queueing networks. Queueing Syst. Theory Appl. 100 (3-4) (2022)
Konstantin E. Avrachenkov, Vivek S. Borkar, Sharayu Moharir, Suhail Mohmad Shah
Dynamic Social Learning Under Graph Constraints. IEEE Trans. Control. Netw. Syst. 9 (3) (2022)
Konstantin Avrachenkov, Vivek S. Borkar, H. P. Dolhare, K. Patil
Full Gradient DQN Reinforcement Learning: A Provably Convergent Scheme. CoRR (2021)
Ari Arapostathis, Vivek S. Borkar
Linear and Dynamic Programs for Risk-Sensitive Cost Minimization. CDC (2021)
S. K. Singh, Vivek S. Borkar, Gaurav S. Kasbekar
User Association in Dense mmWave Networks as Restless Bandits. CoRR (2021)
Siddharth Chandak, Vivek S. Borkar
Concentration of Contractive Stochastic Approximation and Reinforcement Learning. CoRR (2021)
Priyadarshini Kumari, Siddhartha Chaudhuri, Vivek S. Borkar, Subhasis Chaudhuri
A Unified Batch Selection Policy for Active Metric Learning. ECML/PKDD (2) (2021)
Vivek S. Borkar, Shantanu Choudhary, Vaibhav Kumar Gupta, Gaurav S. Kasbekar
Scheduling in wireless networks with spatial reuse of spectrum as restless bandits. Perform. Evaluation (2021)
Vivek S. Borkar, Syomantak Chaudhuri
Accelerating MCMC by Rare Intermittent Resets. VALUETOOLS (2021)
Vivek S. Borkar, Siddharth Chandak, Harsh Dolhare
A Concentration Bound for LSPE(λ). CoRR (2021)
Vivek S. Borkar
A concentration bound for contractive stochastic approximation. Syst. Control. Lett. 153 (2021)
Vivek S. Borkar, Siddharth Chandak
Prospect-theoretic Q-learning. CoRR (2021)
Vivek S. Borkar, Shuhang Chen, Adithya M. Devraj, Ioannis Kontoyiannis, Sean P. Meyn
The ODE Method for Asymptotic Statistics in Stochastic Approximation and Reinforcement Learning. CoRR (2021)
Priyadarshini Kumari, Siddhartha Chaudhuri, Vivek S. Borkar, Subhasis Chaudhuri
Maximizing Conditional Entropy for Batch-Mode Active Learning of Perceptual Metrics. CoRR (2021)
Vivek S. Borkar, Siddharth Chandak
Prospect-theoretic Q-learning. Syst. Control. Lett. 156 (2021)
Arghyadip Roy, Vivek S. Borkar, Prasanna Chaporkar, Abhay Karandikar
Low Complexity Online Radio Access Technology Selection Algorithm in LTE-WiFi HetNet. IEEE Trans. Mob. Comput. 19 (2) (2020)
Ari Arapostathis, Anup Biswas, Vivek S. Borkar, K. Suresh Kumar
. SIAM J. Control. Optim. 58 (6) (2020)
Konstantin Avrachenkov, Vivek S. Borkar
Whittle index based Q-learning for restless bandits with average reward. CoRR (2020)
Vivek S. Borkar, D. Manjunath
Revisiting SIR in the age of COVID-19: Explicit Solutions and Control Problems. CoRR (2020)
Konstantin Avrachenkov, Vivek S. Borkar, Sharayu Moharir, Suhail M. Shah
Dynamic social learning under graph constraints. CoRR (2020)
Aseem Vivek Borkar, Vivek S. Borkar, Arpita Sinha
Aerial monitoring of slow moving convoys using elliptical orbits. Eur. J. Control 46 (2019)
Ari Arapostathis, Vivek S. Borkar
Average cost optimal control under weak hypotheses: Relative value iterations. CoRR (2019)
Vivek S. Borkar, Shantanu Choudhary, Vaibhav Kumar Gupta, Gaurav S. Kasbekar
Scheduling in Wireless Networks with Spatial Reuse of Spectrum as Restless Bandits. CoRR (2019)
Vivek S. Borkar, Vladimir Gaitsgory
Linear Programming Formulation of Long-Run Average Optimal Control Problem. J. Optim. Theory Appl. 181 (1) (2019)
Vivek S. Borkar, Vladimir Gaitsgory, Ilya Shvartsman
On LP Formulations of Optimal Control Problems with Time Averaging and Time Discounting Criteria in Non-Ergodic Case. CDC (2019)
Arghyadip Roy, Vivek S. Borkar, Abhay Karandikar, Prasanna Chaporkar
Online Reinforcement Learning of Optimal Threshold Policies for Markov Decision Processes. CoRR (2019)
Konstantin Avrachenkov, Vivek S. Borkar
A learning algorithm for the Whittle index policy for scheduling web crawlers. Allerton (2019)
Bhumesh Kumar, Vivek S. Borkar, Akhil Shetty
Non-asymptotic error bounds for constant stepsize stochastic approximation for tracking mobile agents. Math. Control. Signals Syst. 31 (4) (2019)
Arghyadip Roy, Vivek S. Borkar, Abhay Karandikar, Prasanna Chaporkar
A Structure-aware Online Learning Algorithm for Markov Decision Processes. VALUETOOLS (2019)
Vivek S. Borkar, Vladimir Gaitsgory, Ilya Shvartsman
LP Formulations of Discrete Time Long-Run Average Optimal Control Problems: The NonErgodic Case. SIAM J. Control. Optim. 57 (3) (2019)
Anand Kalvit, Vivek S. Borkar, Nikhil Karamchandani
Stochastic approximation algorithms for rumor source inference on graphs. Perform. Evaluation 132 (2019)
Vivek S. Borkar, Alexandre Reiffers-Masson
Opinion shaping in social networks using reinforcement learning. CoRR (2019)
Konstantin Avrachenkov, Vivek S. Borkar
Metastability in Stochastic Replicator Dynamics. Dyn. Games Appl. 9 (2) (2019)
Konstantin E. Avrachenkov, Vivek S. Borkar
Whittle Index Policy for Crawling Ephemeral Content. IEEE Trans. Control. Netw. Syst. 5 (1) (2018)
Vivek S. Borkar, Suhail Mohmad Shah
Distributed Algorithms: Tsitsiklis and Beyond. ITA (2018)
Vivek S. Borkar, Sarath Pattathil
Concentration bounds for two time scale stochastic approximation. Allerton (2018)
Arghyadip Roy, Vivek S. Borkar, Abhay Karandikar, Prasanna Chaporkar
A Structure-aware Online Learning Algorithm for Markov Decision Processes. CoRR (2018)
Vivek S. Borkar, Gaurav S. Kasbekar, Sarath Pattathil, Priyesh Y. Shetty
Opportunistic Scheduling as Restless Bandits. IEEE Trans. Control. Netw. Syst. 5 (4) (2018)
Konstantin Avrachenkov, Vivek S. Borkar
Metastability in Stochastic Replicator Dynamics. CoRR (2018)
Suhail M. Shah, Vivek S. Borkar
Q-learning for Markov decision processes with a satisfiability criterion. Syst. Control. Lett. 113 (2018)
Suhail Mohmad Shah, Vivek S. Borkar
Distributed Stochastic Approximation with Local Projections. SIAM J. Optim. 28 (4) (2018)
Suhail M. Shah, Vivek S. Borkar
Distributed Stochastic Approximation with Local Projections. CoRR (2017)
Soham R. Phade, Vivek S. Borkar
A Distributed Boyle-Dykstra-Han Scheme. SIAM J. Optim. 27 (3) (2017)
Vivek S. Borkar
Linear and dynamic programming approaches to degenerate risk-sensitive reward processes. CDC (2017)
Konstantin E. Avrachenkov, Vivek S. Borkar, Sarath Pattathil
Controlling G-AIMD by index policy. CDC (2017)
Anand Kalvit, Vivek S. Borkar, Nikhil Karamchandani
MCMC Approaches to Rumor Source Inference using Pairwise Information. VALUETOOLS (2017)
Vivek S. Borkar
Whittle Index for Partially Observed Binary Markov Decision Processes. IEEE Trans. Autom. Control. 62 (12) (2017)
Vivek S. Borkar, Vikranth Reddy Dwaracherla, Neeraja Sahasrabudhe
Gradient Estimation with Simultaneous Perturbation and Compressive Sensing. J. Mach. Learn. Res. 18 (2017)
Adwaitvedant S. Mathkar, Vivek S. Borkar
Distributed Reinforcement Learning via Gossip. IEEE Trans. Autom. Control. 62 (3) (2017)
V. Anantharam, Vivek S. Borkar
A Variational Formula for Risk-Sensitive Reward. SIAM J. Control. Optim. 55 (2) (2017)
Anupama Kowli, Joel Jose, Vivek S. Borkar, Imthias Ahamed T. P.
A dynamic programming framework for optimal home scheduling. ISGT Asia (2017)
Vivek S. Borkar, Gaurav S. Kasbekar, Sarath Pattathil, Priyesh Y. Shetty
Opportunistic Scheduling as Restless Bandits. CoRR (2017)
Dileep M. Kalathil, Vivek S. Borkar, Rahul Jain
Approachability in Stackelberg Stochastic Games with Vector Costs. Dyn. Games Appl. 7 (3) (2017)
Vivek S. Borkar, Sarath Pattathil
Whittle Indexability in Egalitarian Processor Sharing Systems. CoRR (2017)
Ankit Kumar, Vivek S. Borkar, Nikhil Karamchandani
Temporally Agnostic Rumor-Source Detection. IEEE Trans. Signal Inf. Process. over Networks 3 (2) (2017)
Aseem Vivek Borkar, Vivek S. Borkar, Arpita Sinha
Vector Field Guidance for Convoy Monitoring Using Elliptical Orbits. CoRR (2017)
Aseem Vivek Borkar, Vivek S. Borkar, Arpita Sinha
Vector field guidance for convoy monitoring using elliptical orbits. CDC (2017)
Ari Arapostathis, Vivek S. Borkar
A Correction to "A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions". SIAM J. Control. Optim. 55 (3) (2017)
Sarath Pattathil, Vivek S. Borkar, Gaurav S. Kasbekar
Distributed Server Allocation for Content Delivery Networks. CoRR (2017)
Prabuchandran K. J., Shalabh Bhatnagar, Vivek S. Borkar
Actor-Critic Algorithms with Online Feature Adaptation. ACM Trans. Model. Comput. Simul. 26 (4) (2016)
Konstantin Avrachenkov, Vivek S. Borkar, Krishnakant Saboo
Distributed and Asynchronous Methods for Semi-supervised Learning. WAW (2016)
Konstantin Avrachenkov, Vivek S. Borkar, Arun Kadavankandy, Jithin Kazuthuveettil Sreedharan
Comparison of Random Walk Based Techniques for Estimating Network Averages. CSoNet (2016)
Alankar Jain, Vivek S. Borkar, Dinesh Garg
Fast rumor source identification via random walks. Soc. Netw. Anal. Min. 6 (1) (2016)
Vivek S. Borkar, Nikhil Karamchandani, Sharad Mirani
Randomized Kaczmarz for Rank Aggregation from Pairwise Comparisons. CoRR (2016)
Adwaitvedant S. Mathkar, Vivek S. Borkar
Nonlinear Gossip. SIAM J. Control. Optim. 54 (3) (2016)
Gugan Thoppe, Vivek S. Borkar
A concentration result for stochastic approximation (Extended abstract). ITA (2016)
Vivek S. Borkar, Raaz Dwivedi, Neeraja Sahasrabudhe
Gaussian approximations in high dimensional estimation. Syst. Control. Lett. 92 (2016)
Vivek S. Borkar, Nikhil Karamchandani, Sharad Mirani
Randomized Kaczmarz for rank aggregation from pairwise comparisons. ITW (2016)

Vivek S. Borkar.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Vivek S. Borkar