Kelly W. Zhang

26 papers A* 4Journal 21Unranked 1
YearRankTypeTitle / Venue / Authors
2026 J jnl
Statistical Reinforcement Learning in the Real World: A Survey of Challenges and Future Directions.
CoRR
Asim H. Gazi, Yongyi Guo, Daiqi Gao, Ziping Xu, Kelly W. Zhang, Susan A. Murphy
2026 J jnl
Tabular Foundation Models Can Do Survival Analysis.
CoRR
Da In Kim, Wei Siang Lai, Kelly W. Zhang
2025 A* conf
A Deployed Online Reinforcement Learning Algorithm in an Oral Health Clinical Trial.
AAAI
Anna L. Trella, Kelly W. Zhang, Hinal Jajal, Inbal Nahum-Shani, Vivek Shetty, Finale Doshi-Velez, Susan A. Murphy
2025 J jnl
Contextual Thompson Sampling via Generation of Missing Data.
CoRR
Kelly W. Zhang, Tiffany Tianhui Cai, Hongseok Namkoong, Daniel Russo
2025 J jnl
Impatient Bandits: Optimizing for the Long-Term Without Delay.
CoRR
Kelly W. Zhang, Thomas Baldwin-McDonald, Kamil Ciosek, Lucas Maystre, Daniel Russo
2025 J jnl
Reproducible workflow for online AI in digital health.
CoRR
Susobhan Ghosh, Bhanu T. Gulapalli, Daiqi Gao, Asim H. Gazi, Anna L. Trella, Ziping Xu, Kelly W. Zhang, Susan A. Murphy
2024 J jnl
A Deployed Online Reinforcement Learning Algorithm In An Oral Health Clinical Trial.
CoRR
Anna L. Trella, Kelly W. Zhang, Hinal Jajal, Inbal Nahum-Shani, Vivek Shetty, Finale Doshi-Velez, Susan A. Murphy
2024 J jnl
Did we personalize? Assessing personalization by an online reinforcement learning algorithm using resampling.
Mach. Learn.
Susobhan Ghosh, Raphael Kim, Prasidh Chhabria, Raaz Dwivedi, Predrag Klasnja, Peng Liao, Kelly W. Zhang, Susan A. Murphy
2024 J jnl
Effective Monitoring of Online Decision-Making Algorithms in Digital Intervention Implementation.
CoRR
Anna L. Trella, Susobhan Ghosh, Erin E. Bonar, Lara N. Coughlin, Finale Doshi-Velez, Yongyi Guo, Pei-Yao Hung, Inbal Nahum-Shani, Vivek Shetty, Maureen A. Walton, Iris Yan, Kelly W. Zhang, Susan A. Murphy
2024 J jnl
Monitoring Fidelity of Online Reinforcement Learning Algorithms in Clinical Trials.
CoRR
Anna L. Trella, Kelly W. Zhang, Inbal Nahum-Shani, Vivek Shetty, Iris Yan, Finale Doshi-Velez, Susan A. Murphy
2024 J jnl
Oralytics Reinforcement Learning Algorithm.
CoRR
Anna L. Trella, Kelly W. Zhang, Stephanie Marita Carpenter, David Elashoff, Zara M. Greer, Inbal Nahum-Shani, Dennis Ruenger, Vivek Shetty, Susan A. Murphy
2024 J jnl
Posterior Sampling via Autoregressive Generation.
CoRR
Kelly W. Zhang, Tiffany Tianhui Cai, Hongseok Namkoong, Daniel Russo
2024 J jnl
The Fallacy of Minimizing Local Regret in the Sequential Task Setting.
CoRR
Ziping Xu, Kelly W. Zhang, Susan A. Murphy
2023 J jnl
Did we personalize? Assessing personalization by an online reinforcement learning algorithm using resampling.
CoRR
Susobhan Ghosh, Raphael Kim, Prasidh Chhabria, Raaz Dwivedi, Predrag V. Klasnja, Peng Liao, Kelly W. Zhang, Susan A. Murphy
2023 A* conf
Reward Design for an Online Reinforcement Learning Algorithm Supporting Oral Self-Care.
AAAI
Anna L. Trella, Kelly W. Zhang, Inbal Nahum-Shani, Vivek Shetty, Finale Doshi-Velez, Susan A. Murphy
2022 J jnl
A Bayesian Approach to Learning Bandit Structure in Markov Decision Processes.
CoRR
Kelly W. Zhang, Omer Gottesman, Finale Doshi-Velez
2022 J jnl
Designing Reinforcement Learning Algorithms for Digital Interventions: Pre-Implementation Guidelines.
Algorithms
Anna L. Trella, Kelly W. Zhang, Inbal Nahum-Shani, Vivek Shetty, Finale Doshi-Velez, Susan A. Murphy
2022 J jnl
Designing Reinforcement Learning Algorithms for Digital Interventions: Pre-implementation Guidelines.
CoRR
Anna L. Trella, Kelly W. Zhang, Inbal Nahum-Shani, Vivek Shetty, Finale Doshi-Velez, Susan A. Murphy
2022 J jnl
Reward Design For An Online Reinforcement Learning Algorithm Supporting Oral Self-Care.
CoRR
Anna L. Trella, Kelly W. Zhang, Inbal Nahum-Shani, Vivek Shetty, Finale Doshi-Velez, Susan A. Murphy
2022 J jnl
Statistical Inference After Adaptive Sampling in Non-Markovian Environments.
CoRR
Kelly W. Zhang, Lucas Janson, Susan A. Murphy
2021 A* conf
Statistical Inference with M-Estimators on Adaptively Collected Data.
NeurIPS
Kelly W. Zhang, Lucas Janson, Susan A. Murphy
2021 J jnl
Statistical Inference with M-Estimators on Bandit Data.
CoRR
Kelly W. Zhang, Lucas Janson, Susan A. Murphy
2020 A* conf
Inference for Batched Bandits.
NeurIPS
Kelly W. Zhang, Lucas Janson, Susan A. Murphy
2020 J jnl
Inference for Batched Bandits.
CoRR
Kelly W. Zhang, Lucas Janson, Susan A. Murphy
2018 J jnl
Language Modeling Teaches You More Syntax than Translation Does: Lessons Learned Through Auxiliary Task Analysis.
CoRR
Kelly W. Zhang, Samuel R. Bowman
2018 — conf
Language Modeling Teaches You More than Translation Does: Lessons Learned Through Auxiliary Syntactic Task Analysis.
BlackboxNLP@EMNLP
Kelly W. Zhang, Samuel R. Bowman