Susan A. Murphy

Publication Activity (10 Years)

Years Active: 2005-2024
Publications (10 Years): 58

Top Topics

Regularization Method

Partial Observability

Reinforcement Learning

Statistical Inference

Top Venues

Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.

UbiComp/ISWC Adjunct

Publications

Eura Nofshin, Siddharth Swaroop, Weiwei Pan, Susan A. Murphy, Finale Doshi-Velez
Reinforcement Learning Interventions on Boundedly Rational Human Agents in Frictionful Tasks. AAMAS (2024)
Eura Nofshin, Siddharth Swaroop, Weiwei Pan, Susan A. Murphy, Finale Doshi-Velez
Reinforcement Learning Interventions on Boundedly Rational Human Agents in Frictionful Tasks. CoRR (2024)
Susobhan Ghosh, Yongyi Guo, Pei-Yao Hung, Lara N. Coughlin, Erin Bonar, Inbal Nahum-Shani, Maureen A. Walton, Susan A. Murphy
reBandit: Random Effects based Online RL algorithm for Reducing Cannabis Use. CoRR (2024)
Anna L. Trella, Kelly W. Zhang, Stephanie M. Carpenter, David Elashoff, Zara M. Greer, Inbal Nahum-Shani, Dennis Ruenger, Vivek Shetty, Susan A. Murphy
Oralytics Reinforcement Learning Algorithm. CoRR (2024)
Xueqing Liu, Kyra Gan, Esmaeil Keyvanshokooh, Susan A. Murphy
Online Uniform Risk Times Sampling: First Approximation Algorithms, Learning Augmentation with Full Confidence Interval Integration. CoRR (2024)
Anna L. Trella, Kelly W. Zhang, Inbal Nahum-Shani, Vivek Shetty, Iris Yan, Finale Doshi-Velez, Susan A. Murphy
Monitoring Fidelity of Online Reinforcement Learning Algorithms in Clinical Trials. CoRR (2024)
Susobhan Ghosh, Raphael Kim, Prasidh Chhabria, Raaz Dwivedi, Predrag Klasnja, Peng Liao, Kelly W. Zhang, Susan A. Murphy
Did we personalize? Assessing personalization by an online reinforcement learning algorithm using resampling. Mach. Learn. 113 (7) (2024)
Zana Buçinca, Siddharth Swaroop, Amanda E. Paluch, Susan A. Murphy, Krzysztof Z. Gajos
Towards Optimizing Human-Centric Objectives in AI-Assisted Decision-Making With Offline Reinforcement Learning. CoRR (2024)
Anna L. Trella, Walter Dempsey, Finale Doshi-Velez, Susan A. Murphy
Non-Stationary Latent Auto-Regressive Bandits. CoRR (2024)
Ziping Xu, Kelly W. Zhang, Susan A. Murphy
The Fallacy of Minimizing Local Regret in the Sequential Task Setting. CoRR (2024)
Kyra Gan, Esmaeil Keyvanshokooh, Xueqing Liu, Susan A. Murphy
Contextual Bandits with Budgeted Information Reveal. AISTATS (2024)
Yongyi Guo, Ziping Xu, Susan A. Murphy
Online learning in bandits with predicted context. AISTATS (2024)
Sarah Rathnam, Sonali Parbhoo, Weiwei Pan, Susan A. Murphy, Finale Doshi-Velez
The Unintended Consequences of Discount Regularization: Improving Regularization in Certainty Equivalence Reinforcement Learning. ICML (2023)
Jessica R. Golbus, Kashvi Gupta, Rachel Stevens, V. Swetha Jeganathan, Evan Luff, Jieru Shi, Walter Dempsey, Thomas Boyden, Bhramar Mukherjee, Sarah Kohnstamm, Vlad Taralunga, Vik Kheterpal, Susan A. Murphy, Predrag V. Klasnja, Sachin Kheterpal, Brahmajee K. Nallamothu
A randomized trial of a mobile health intervention to augment cardiac rehabilitation. npj Digit. Medicine 6 (2023)
Eura Shin, Predrag Klasnja, Susan A. Murphy, Finale Doshi-Velez
Online model selection by learning how compositional kernels evolve. Trans. Mach. Learn. Res. 2023 (2023)
Karine Karine, Predrag V. Klasnja, Susan A. Murphy, Benjamin M. Marlin
Assessing the Impact of Context Inference Error and Partial Observability on RL Methods for Just-In-Time Adaptive Interventions. CoRR (2023)
Shuangning Li, Lluis Salvat Niell, Sung Won Choi, Inbal Nahum-Shani, Guy Shani, Susan A. Murphy
Dyadic Reinforcement Learning. CoRR (2023)
Anna L. Trella, Kelly W. Zhang, Inbal Nahum-Shani, Vivek Shetty, Finale Doshi-Velez, Susan A. Murphy
Reward Design for an Online Reinforcement Learning Algorithm Supporting Oral Self-Care. AAAI (2023)
Sarah Rathnam, Sonali Parbhoo, Weiwei Pan, Susan A. Murphy, Finale Doshi-Velez
The Unintended Consequences of Discount Regularization: Improving Regularization in Certainty Equivalence Reinforcement Learning. CoRR (2023)
Martin Cousineau, Vedat Verter, Susan A. Murphy, Joelle Pineau
Estimating causal effects with optimization-based methods: A review and empirical comparison. Eur. J. Oper. Res. 304 (2) (2023)
Karine Karine, Predrag V. Klasnja, Susan A. Murphy, Benjamin M. Marlin
Assessing the Impact of Context Inference Error and Partial Observability on RL Methods for Just-In-Time Adaptive Interventions. UAI (2023)
Dimitris Bertsimas, Predrag V. Klasnja, Susan A. Murphy, Liangyuan Na
Data-driven Interpretable Policy Construction for Personalized Mobile Health. ICDH (2022)
Anna L. Trella, Kelly W. Zhang, Inbal Nahum-Shani, Vivek Shetty, Finale Doshi-Velez, Susan A. Murphy
Reward Design For An Online Reinforcement Learning Algorithm Supporting Oral Self-Care. CoRR (2022)
Anna L. Trella, Kelly W. Zhang, Inbal Nahum-Shani, Vivek Shetty, Finale Doshi-Velez, Susan A. Murphy
Designing Reinforcement Learning Algorithms for Digital Interventions: Pre-implementation Guidelines. CoRR (2022)
Kelly W. Zhang, Lucas Janson, Susan A. Murphy
Statistical Inference After Adaptive Sampling in Non-Markovian Environments. CoRR (2022)
Anna L. Trella, Kelly W. Zhang, Inbal Nahum-Shani, Vivek Shetty, Finale Doshi-Velez, Susan A. Murphy
Designing Reinforcement Learning Algorithms for Digital Interventions: Pre-Implementation Guidelines. Algorithms 15 (8) (2022)
Martin Cousineau, Vedat Verter, Susan A. Murphy, Joelle Pineau
Estimating causal effects with optimization-based methods: A review and empirical comparison. CoRR (2022)
Eura Shin, Siddharth Swaroop, Weiwei Pan, Susan A. Murphy, Finale Doshi-Velez
Modeling Mobile Health Users as Reinforcement Learning Agents. CoRR (2022)
Kelly W. Zhang, Lucas Janson, Susan A. Murphy
Statistical Inference with M-Estimators on Adaptively Collected Data. NeurIPS (2021)
Sabina Tomkins, Peng Liao, Predrag V. Klasnja, Susan A. Murphy
IntelligentPooling: practical Thompson sampling for mHealth. Mach. Learn. 110 (9) (2021)
Sarah Rathnam, Susan A. Murphy, Finale Doshi-Velez
Comparison and Unification of Three Regularization Methods in Batch Reinforcement Learning. CoRR (2021)
Jiayu Yao, Emma Brunskill, Weiwei Pan, Susan A. Murphy, Finale Doshi-Velez
Power Constrained Bandits. MLHC (2021)
Kelly W. Zhang, Lucas Janson, Susan A. Murphy
Statistical Inference with M-Estimators on Bandit Data. CoRR (2021)
Eura Shin, Pedja Klasnja, Susan A. Murphy, Finale Doshi-Velez
Online structural kernel selection for mobile health. CoRR (2021)
Marianne Menictas, Sabina Tomkins, Susan A. Murphy
Fast Physical Activity Suggestions: Efficient Hyperparameter Learning in Mobile Health. CoRR (2020)
Sabina Tomkins, Peng Liao, Predrag V. Klasnja, Susan A. Murphy
IntelligentPooling: Practical Thompson Sampling for mHealth. CoRR (2020)
Peng Liao, Kristjan H. Greenewald, Predrag V. Klasnja, Susan A. Murphy
Personalized HeartSteps: A Reinforcement Learning Algorithm for Optimizing Physical Activity. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4 (1) (2020)
Marianne Menictas, Sabina Tomkins, Susan A. Murphy
Streamlined Empirical Bayes Fitting of Linear Mixed Models in Mobile Health. CoRR (2020)
Jiayu Yao, Emma Brunskill, Weiwei Pan, Susan A. Murphy, Finale Doshi-Velez
Power-Constrained Bandits. CoRR (2020)
Kelly W. Zhang, Lucas Janson, Susan A. Murphy
Inference for Batched Bandits. CoRR (2020)
Kelly W. Zhang, Lucas Janson, Susan A. Murphy
Inference for Batched Bandits. NeurIPS (2020)
Sabina Tomkins, Peng Liao, Predrag V. Klasnja, Serena Yeung, Susan A. Murphy
Rapidly Personalizing Mobile Health Treatment Policies with Limited Data. CoRR (2020)
Mashfiqui Rabbi, Meredith Philyaw-Kotov, Jinseok Li, Katherine Li, Bess Rothman, Lexa Giragosian, Maya Reyes, Hannah Gadway, Rebecca M. Cunningham, Erin Bonar, Inbal Nahum-Shani, Maureen A. Walton, Susan A. Murphy, Predrag V. Klasnja
Translating Behavioral Theory into Technological Interventions: Case Study of an mHealth App to Increase Self-reporting of Substance-Use Related Data. CoRR (2020)
Ashley E. Walton, Linda M. Collins, Predrag V. Klasnja, Inbal Nahum-Shani, Mashfiqui Rabbi, Maureen A. Walton, Susan A. Murphy
The Micro-Randomized Trial for Developing Digital Interventions: Experimental Design Considerations. CoRR (2020)
Tao Zhang, Geoff A. Jarrad, Susan A. Murphy, Niranjan Bidargaddi
A smartphone-based behavioural activation application using recommender system. UbiComp/ISWC Adjunct (2019)
Mashfiqui Rabbi, Katherine Li, H. Yanna Yan, Kelly Hall, Predrag V. Klasnja, Susan A. Murphy
ReVibe: A Context-assisted Evening Recall Approach to Improve Self-report Adherence. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3 (4) (2019)
Peng Liao, Kristjan H. Greenewald, Predrag V. Klasnja, Susan A. Murphy
Personalized HeartSteps: A Reinforcement Learning Algorithm for Optimizing Physical Activity. CoRR (2019)
Peng Liao, Predrag V. Klasnja, Susan A. Murphy
Off-Policy Estimation of Long-Term Average Outcomes with Applications to Mobile Health. CoRR (2019)
Sabina Tomkins, Predrag V. Klasnja, Susan A. Murphy
Personalizing Intervention Probabilities By Pooling. CoRR (2018)
Peng Liao, Walter Dempsey, Hillol Sarker, Syed Monowar Hossain, Mustafa al'Absi, Predrag V. Klasnja, Susan A. Murphy
Just-in-Time but Not Too Much: Determining Treatment Timing in Mobile Health. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2 (4) (2018)
Blake Wagner III, Elaine Liu, Steven D. Shaw, Gleb Iakovlev, Linlu Zhou, Christina N. Harrington, Gregory D. Abowd, Carolyn Yoon, Santosh Kumar, Susan A. Murphy, Bonnie Spring, Inbal Nahum-Shani
wrapper: operationalizing engagement strategies in mHealth. UbiComp/ISWC Adjunct (2017)
Kristjan H. Greenewald, Ambuj Tewari, Susan A. Murphy, Predrag V. Klasnja
Action Centered Contextual Bandits. NIPS (2017)
Huitian Lei, Ambuj Tewari, Susan A. Murphy
An Actor-Critic Contextual Bandit Algorithm for Personalized Mobile Health Interventions. CoRR (2017)
Walter H. Dempsey, Alexander Moreno, Christy K. Scott, Michael L. Dennis, David H. Gustafson, Susan A. Murphy, James M. Rehg
iSurvive: An Interpretable, Event-time Prediction Model for mHealth. ICML (2017)
Niko Beerenwinkel, Holger Fröhlich, Susan A. Murphy
Addressing the Computational Challenges of Personalized Medicine (Dagstuhl Seminar 17472). Dagstuhl Reports 7 (11) (2017)
Santosh Kumar, Gregory D. Abowd, William T. Abraham, Mustafa al'Absi, Duen Horng Chau, Emre Ertin, Deborah Estrin, Deepak Ganesan, Timothy Hnat, Syed Monowar Hossain, Zachary G. Ives, Jacqueline Kerr, Benjamin M. Marlin, Susan A. Murphy, James M. Rehg, Inbal Nahum-Shani, Vivek Shetty, Ida Sim, Bonnie Spring, Mani B. Srivastava, David W. Wetter
Center of Excellence for Mobile Sensor Data-to-Knowledge (MD2K). IEEE Pervasive Comput. 16 (2) (2017)
Mashfiqui Rabbi, Meredith Philyaw-Kotov, Jinseok Lee, Anthony Mansour, Laura Dent, Xiaolei Wang, Rebecca M. Cunningham, Erin Bonar, Inbal Nahum-Shani, Predrag V. Klasnja, Maureen A. Walton, Susan A. Murphy
SARA: a mobile app to engage users in health data collection. UbiComp/ISWC Adjunct (2017)
Susan A. Murphy, Yanzhen Deng, Eric B. Laber, Hamid Reza Maei, Richard S. Sutton, Katie Witkiewitz
A Batch, Off-Policy, Actor-Critic Algorithm for Optimizing the Average Reward. CoRR (2016)
Santosh Kumar, Gregory D. Abowd, William T. Abraham, Mustafa al'Absi, J. Gayle Beck, Duen Horng Chau, Tyson Condie, David E. Conroy, Emre Ertin, Deborah Estrin, Deepak Ganesan, Cho Lam, Benjamin M. Marlin, Clay B. Marsh, Susan A. Murphy, Inbal Nahum-Shani, Kevin Patrick, James M. Rehg, Moushumi Sharmin, Vivek Shetty, Ida Sim, Bonnie Spring, Mani B. Srivastava, David W. Wetter
Center of excellence for mobile sensor data-to-knowledge (MD2K). J. Am. Medical Informatics Assoc. 22 (6) (2015)
Kun Deng, Russ Greiner, Susan A. Murphy
Budgeted Learning for Developing Personalized Treatment. ICMLA (2014)
Raphael Fonteneau, Susan A. Murphy, Louis Wehenkel, Damien Ernst
Stratégies d'échantillonnage pour l'apprentissage par renforcement batch. Rev. d'Intelligence Artif. 27 (2) (2013)
Raphael Fonteneau, Susan A. Murphy, Louis Wehenkel, Damien Ernst
Batch mode reinforcement learning based on the synthesis of artificial trajectories. Ann. Oper. Res. 208 (1) (2013)
Daniel J. Lizotte, Michael Bowling, Susan A. Murphy
Linear Fitted-Q Iteration with Multiple Reward Functions. ICAPS (2013)
Eric B. Laber, Susan A. Murphy
Small Sample Inference for Generalization Error in Classification Using the CUD Bound CoRR (2012)
Daniel J. Lizotte, Michael Bowling, Susan A. Murphy
Linear fitted-Q iteration with multiple reward functions. J. Mach. Learn. Res. 13 (2012)
Kun Deng, Joelle Pineau, Susan A. Murphy
Active Learning for Developing Personalized Treatment CoRR (2012)
Susan M. Shortreed, Eric B. Laber, Daniel J. Lizotte, T. Scott Stroup, Joelle Pineau, Susan A. Murphy
Informing sequential clinical decision-making through reinforcement learning: an empirical study. Mach. Learn. 84 (1-2) (2011)
Raphael Fonteneau, Susan A. Murphy, Louis Wehenkel, Damien Ernst
Active exploration by searching for experiments that falsify the computed control policy. ADPRL (2011)
Kun Deng, Joelle Pineau, Susan A. Murphy
Active learning for personalizing treatment. ADPRL (2011)
Raphael Fonteneau, Susan A. Murphy, Louis Wehenkel, Damien Ernst
Estimation Monte Carlo sans modèle de politiques de décision. Rev. d'Intelligence Artif. 25 (3) (2011)
Kun Deng, Joelle Pineau, Susan A. Murphy
Active Learning for Developing Personalized Treatment. UAI (2011)
Raphael Fonteneau, Susan A. Murphy, Louis Wehenkel, Damien Ernst
Towards Min Max Generalization in Reinforcement Learning. ICAART (Revised Selected Papers) (2010)
Daniel J. Lizotte, Michael H. Bowling, Susan A. Murphy
Efficient Reinforcement Learning with Multiple Reward Functions for Randomized Controlled Trial Analysis. ICML (2010)
Raphael Fonteneau, Susan A. Murphy, Louis Wehenkel, Damien Ernst
A Cautious Approach to Generalization in Reinforcement Learning. ICAART (1) (2010)
Raphael Fonteneau, Susan A. Murphy, Louis Wehenkel, Damien Ernst
Model-Free Monte Carlo-like Policy Evaluation. AISTATS (2010)
Raphaël Fonteneau, Susan A. Murphy, Louis Wehenkel, Damien Ernst
Inferring bounds on the performance of a control policy from a sample of trajectories. ADPRL (2009)
Eric B. Laber, Susan A. Murphy
Small Sample Inference for Generalization Error in Classification Using the CUD Bound. UAI (2008)
Lacey Gunter, Ji Zhu, Susan A. Murphy
Variable Selection for Optimal Decision Making. AIME (2007)
Susan A. Murphy
A Generalization Error for Q-Learning. J. Mach. Learn. Res. 6 (2005)