Doina Precup - RankMe

514 papers A* 124A 34B 7C 4Misc 3Journal 254Unranked 85

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Affordances Enable Partial World Modeling with LLMs. CoRR Khimya Khetarpal, Gheorghe Comanici, Jonathan Richens, Jeremy Shar, Fei Xia, Laurent Orseau, Aleksandra Faust, Doina Precup
2026	A*	`conf`	Bootstrapping Personalized Insulin Therapy via Model-Based Reinforcement Learning: An In Silico Study. AAAI Sumana Basu, Flemming Kondrup, Adriana Romero-Soriano, Doina Precup
2026	J	`jnl`	Detoxifying LLMs via Representation Erasure-Based Preference Optimization. CoRR Nazanin Mohammadi Sepahvand, Eleni Triantafillou, Hugo Larochelle, Doina Precup, Daniel M. Roy, Gintare Karolina Dziugaite
2026	J	`jnl`	Fluid-Agent Reinforcement Learning. CoRR Shishir Sharma, Doina Precup, Theodore J. Perkins
2025	J	`jnl`	Agency Is Frame-Dependent. CoRR David Abel, André Barreto, Michael Bowling, Will Dabney, Shi Dong, Steven Hansen, Anna Harutyunyan, Khimya Khetarpal, Clare Lyle, Razvan Pascanu, Georgios Piliouras, Doina Precup, Jonathan Richens, Mark Rowland, Tom Schaul, Satinder Singh
2025	J	`jnl`	Capacity-Constrained Continual Learning. CoRR Zheng Wen, Doina Precup, Benjamin Van Roy, Satinder Singh
2025	J	`jnl`	Capturing Individual Human Preferences with Reward Features. CoRR André Barreto, Vincent Dumoulin, Yiran Mao, Nicolas Perez Nieves, Bobak Shahriari, Yann N. Dauphin, Doina Precup, Hugo Larochelle
2025	J	`jnl`	Cracking the Code of Action: a Generative Approach to Affordances for Reinforcement Learning. CoRR Lynn Cherif, Flemming Kondrup, David Venuto, Ankit Anand, Doina Precup, Khimya Khetarpal
2025	J	`jnl`	Discovering Temporal Structure: An Overview of Hierarchical Reinforcement Learning. CoRR Martin Klissarov, Akhil Bagaria, Ziyan Luo, George Dimitri Konidaris, Doina Precup, Marlos C. Machado
2025	—	`conf`	Excitatory-Inhibitory Dynamics in Adaptive Decision-Making. ICONIP (3) Veronica Chelu, Doina Precup
2025	J	`jnl`	Exploring Sparse Adapters for Scalable Merging of Parameter Efficient Experts. CoRR Samin Yeasar Arnob, Zhan Su, Minseon Kim, Oleksiy Ostapenko, Riyasat Ohib, Esra'a Saleh, Doina Precup, Lucas Caccia, Alessandro Sordoni
2025	J	`jnl`	Incorporating Spatial Information into Goal-Conditioned Hierarchical Reinforcement Learning via Graph Representations. CoRR Shuyuan Zhang, Zihan Wang, Xiao-Wen Chang, Doina Precup
2025	J	`jnl`	Incorporating Spatial Information into Goal-Conditioned Hierarchical Reinforcement Learning via Graph Representations. Trans. Mach. Learn. Res. Shuyuan Zhang, Zihan Wang, Xiao-Wen Chang, Doina Precup
2025	A*	`conf`	Langevin Soft Actor-Critic: Efficient Exploration through Uncertainty-Driven Critic Learning. ICLR Haque Ishfaq, Guangyuan Wang, Sami Nur Islam, Doina Precup
2025	J	`jnl`	Langevin Soft Actor-Critic: Efficient Exploration through Uncertainty-Driven Critic Learning. CoRR Haque Ishfaq, Guangyuan Wang, Sami Nur Islam, Doina Precup
2025	J	`jnl`	Language Agents Mirror Human Causal Reasoning Biases. How Can We Help Them Think Like Scientists? CoRR Anthony GX-Chen, Dongyan Lin, Mandana Samiei, Doina Precup, Blake A. Richards, Rob Fergus, Kenneth Marino
2025	A*	`conf`	MaestroMotif: Skill Design from Artificial Intelligence Feedback. ICLR Martin Klissarov, Mikael Henaff, Roberta Raileanu, Shagun Sodhani, Pascal Vincent, Amy Zhang, Pierre-Luc Bacon, Doina Precup, Marlos C. Machado, Pierluca D'Oro
2025	J	`jnl`	On Mobile Ad Hoc Networks for Coverage of Partially Observable Worlds. CoRR Edwin Meriaux, Shuo Wen, Louis-Roy Langevin, Doina Precup, Antonio Loría, Gregory Dudek
2025	J	`jnl`	On the geometry and topology of representations: the manifolds of modular addition. CoRR Gabriela Moisescu-Pareja, Gavin McCracken, Harley Wiltzer, Vincent Létourneau, Colin Daniels, Doina Precup, Jonathan Love
2025	J	`jnl`	Plasticity as the Mirror of Empowerment. CoRR David Abel, Michael Bowling, André Barreto, Will Dabney, Shi Dong, Steven Hansen, Anna Harutyunyan, Khimya Khetarpal, Clare Lyle, Razvan Pascanu, Georgios Piliouras, Doina Precup, Jonathan Richens, Mark Rowland, Tom Schaul, Satinder Singh
2025	J	`jnl`	RL Fine-Tuning Heals OOD Forgetting in SFT. CoRR Hangzhan Jin, Sitao Luan, Sicheng Lyu, Guillaume Rabusseau, Reihaneh Rabbany, Doina Precup, Mohammad Hamdaqa
2025	A*	`conf`	Rejecting Hallucinated State Targets during Planning. ICML Harry Zhao, Tristan Sylvain, Romain Laroche, Doina Precup, Yoshua Bengio
2025	J	`jnl`	Relative Trajectory Balance is equivalent to Trust-PCL. CoRR Tristan Deleu, Padideh Nouri, Yoshua Bengio, Doina Precup
2025	J	`jnl`	Robust Reward Modeling via Causal Rubrics. CoRR Pragya Srivastava, Harman Singh, Rahul Madhavan, Gandharv Patil, Sravanti Addepalli, Arun Suggala, Rengarajan Aravamudhan, Soumya Sharma, Anirban Laha, Aravindan Raghuveer, Karthikeyan Shanmugam, Doina Precup
2025	J	`jnl`	SCAR: Shapley Credit Assignment for More Efficient RLHF. CoRR Meng Cao, Shuyuan Zhang, Xiao-Wen Chang, Doina Precup
2025	A*	`conf`	Selective Unlearning via Representation Erasure Using Domain Adversarial Training. ICLR Nazanin Mohammadi Sepahvand, Eleni Triantafillou, Hugo Larochelle, Doina Precup, James J. Clark, Daniel M. Roy, Gintare Karolina Dziugaite
2025	A	`conf`	Soft Condorcet Optimization for Ranking of General Agents. AAMAS Marc Lanctot, Kate Larson, Michael Kaisers, Quentin Berthet, Ian Gemp, Manfred Diaz, Roberto-Rafael Maura-Rivero, Yoram Bachrach, Anna Koop, Doina Precup
2025	J	`jnl`	Sparse-Reg: Improving Sample Complexity in Offline Reinforcement Learning using Sparsity. CoRR Samin Yeasar Arnob, Scott Fujimoto, Doina Precup
2025	A*	`conf`	Training Language Models to Self-Correct via Reinforcement Learning. ICLR Aviral Kumar, Vincent Zhuang, Rishabh Agarwal, Yi Su, John D. Co-Reyes, Avi Singh, Kate Baumli, Shariq Iqbal, Colton Bishop, Rebecca Roelofs, Lei M. Zhang, Kay McKinney, Disha Shrivastava, Cosmin Paduraru, George Tucker, Doina Precup, Feryal M. P. Behbahani, Aleksandra Faust
2025	J	`jnl`	Uncovering a Universal Abstract Algorithm for Modular Addition in Neural Networks. CoRR Gavin McCracken, Gabriela Moisescu-Pareja, Vincent Létourneau, Doina Precup, Jonathan Love
2025	J	`jnl`	Understanding Behavioral Metric Learning: A Large-Scale Study on Distracting Reinforcement Learning Environments. CoRR Ziyan Luo, Tianwei Ni, Pierre-Luc Bacon, Doina Precup, Xujie Si
2024	A*	`conf`	Adaptive Exploration for Data-Efficient General Value Function Evaluations. NeurIPS Arushi Jain, Josiah Hanna, Doina Precup
2024	J	`jnl`	Adaptive Exploration for Data-Efficient General Value Function Evaluations. CoRR Arushi Jain, Josiah P. Hanna, Doina Precup
2024	J	`jnl`	An Attentive Approach for Building Partial Reasoning Agents from Pixels. Trans. Mach. Learn. Res. Safa Alver, Doina Precup
2024	A*	`conf`	Code as Reward: Empowering Reinforcement Learning with VLMs. ICML David Venuto, Mohammad Sami Nur Islam, Martin Klissarov, Doina Precup, Sherry Yang, Ankit Anand
2024	J	`jnl`	Code as Reward: Empowering Reinforcement Learning with VLMs. CoRR David Venuto, Mohammad Sami Nur Islam, Martin Klissarov, Doina Precup, Sherry Yang, Ankit Anand
2024	A	`conf`	Conditions on Preference Relations that Guarantee the Existence of Optimal Policies. AISTATS Jonathan Colaço Carr, Prakash Panangaden, Doina Precup
2024	J	`jnl`	Connecting weighted automata, tensor networks and recurrent neural networks through spectral learning. Mach. Learn. Tianyu Li, Doina Precup, Guillaume Rabusseau
2024	A*	`conf`	Consciousness-Inspired Spatio-Temporal Abstractions for Better Generalization in Reinforcement Learning. ICLR Harry Zhao, Safa Alver, Harm van Seijen, Romain Laroche, Doina Precup, Yoshua Bengio
2024	Misc	`conf`	CryCeleb: A Speaker Verification Dataset Based on Infant Cry Sounds. ICASSP David Budaghyan, Charles C. Onu, Arsenii Gorin, Cem Subakan, Doina Precup
2024	A	`conf`	Discrete Probabilistic Inference as Control in Multi-path Environments. UAI Tristan Deleu, Padideh Nouri, Nikolay Malkin, Doina Precup, Yoshua Bengio
2024	J	`jnl`	Discrete Probabilistic Inference as Control in Multi-path Environments. CoRR Tristan Deleu, Padideh Nouri, Nikolay Malkin, Doina Precup, Yoshua Bengio
2024	J	`jnl`	Effective Protein-Protein Interaction Exploration with PPIretrieval. CoRR Chenqing Hua, Connor W. Coley, Guy Wolf, Doina Precup, Shuangjia Zheng
2024	A*	`conf`	Efficient Reinforcement Learning by Discovering Neural Pathways. NeurIPS Samin Yeasar Arnob, Riyasat Ohib, Sergey M. Plis, Amy Zhang, Alessandro Sordoni, Doina Precup
2024	J	`jnl`	EnzymeFlow: Generating Reaction-specific Enzyme Catalytic Pockets through Flow Matching and Co-Evolutionary Dynamics. CoRR Chenqing Hua, Yong Liu, Dinghuai Zhang, Odin Zhang, Sitao Luan, Kevin K. Yang, Guy Wolf, Doina Precup, Shuangjia Zheng
2024	J	`jnl`	Fairness in Reinforcement Learning with Bisimulation Metrics. CoRR Sahand Rezaei-Shoshtari, Hanna Yurchyk, Scott Fujimoto, Doina Precup, David Meger
2024	A*	`conf`	Finding Increasingly Large Extremal Graphs with AlphaZero and Tabu Search. IJCAI Abbas Mehrabian, Ankit Anand, Hyunjik Kim, Nicolas Sonnerat, Matej Balog, Gheorghe Comanici, Tudor Berariu, Andrew Lee, Anian Ruoss, Anna Bulanova, Daniel Toyama, Sam Blackwell, Bernardino Romera-Paredes, Petar Velickovic, Laurent Orseau, Joonkyung Lee, Anurag Murty Naredla, Doina Precup, Adam Zsolt Wagner
2024	J	`jnl`	Functional Acceleration for Policy Mirror Descent. CoRR Veronica Chelu, Doina Precup
2024	J	`jnl`	Generative Active Learning for the Search of Small-molecule Protein Binders. CoRR Maksym Korablyov, Cheng-Hao Liu, Moksh Jain, Almer M. van der Sloot, Eric Jolicoeur, Edward Ruediger, Andrei Cristian Nica, Emmanuel Bengio, Kostiantyn Lapchevskyi, Daniel St-Cyr, Doris Alexandra Schuetz, Victor Ion Butoi, Jarrid Rector-Brooks, Simon Blackburn, Leo Feng, Hadi Nekoei, Sai Krishna Gottipati, Priyesh Vijayan, Prateek Gupta, Ladislav Rampásek, Sasikanth Avancha, Pierre-Luc Bacon, William L. Hamilton, Brooks Paige, Sanchit Misra, Stanislaw Kamil Jastrzebski, Bharat Kaul, Doina Precup, José Miguel Hernández-Lobato, Marwin H. S. Segler, Michael M. Bronstein, Anne Marinier, Mike Tyers, Yoshua Bengio
2024	J	`jnl`	Identifying and Addressing Delusions for Target-Directed Decision-Making. CoRR Mingde Zhao, Tristan Sylvain, Doina Precup, Yoshua Bengio
2024	A*	`conf`	Learning Successor Features the Simple Way. NeurIPS Raymond Chua, Arna Ghosh, Christos Kaplanis, Blake A. Richards, Doina Precup
2024	J	`jnl`	Learning Successor Features the Simple Way. CoRR Raymond Chua, Arna Ghosh, Christos Kaplanis, Blake A. Richards, Doina Precup
2024	J	`jnl`	MaestroMotif: Skill Design from Artificial Intelligence Feedback. CoRR Martin Klissarov, Mikael Henaff, Roberta Raileanu, Shagun Sodhani, Pascal Vincent, Amy Zhang, Pierre-Luc Bacon, Doina Precup, Marlos C. Machado, Pierluca D'Oro
2024	J	`jnl`	Mitigating Downstream Model Risks via Model Provenance. CoRR Keyu Wang, Abdullah Norozi Iranzad, Scott Schaffter, Doina Precup, Jonathan Lebensold
2024	A*	`conf`	Mixtures of Experts Unlock Parameter Scaling for Deep RL. ICML Johan S. Obando-Ceron, Ghada Sokar, Timon Willi, Clare Lyle, Jesse Farebrother, Jakob Nicolaus Foerster, Gintare Karolina Dziugaite, Doina Precup, Pablo Samuel Castro
2024	J	`jnl`	Mixtures of Experts Unlock Parameter Scaling for Deep RL. CoRR Johan S. Obando-Ceron, Ghada Sokar, Timon Willi, Clare Lyle, Jesse Farebrother, Jakob N. Foerster, Gintare Karolina Dziugaite, Doina Precup, Pablo Samuel Castro
2024	J	`jnl`	More Efficient Randomized Exploration for Reinforcement Learning via Approximate Sampling. RLJ Haque Ishfaq, Yixin Tan, Yu Yang, Qingfeng Lan, Jianfeng Lu, A. Rupam Mahmood, Doina Precup, Pan Xu
2024	J	`jnl`	More Efficient Randomized Exploration for Reinforcement Learning via Approximate Sampling. CoRR Haque Ishfaq, Yixin Tan, Yu Yang, Qingfeng Lan, Jianfeng Lu, A. Rupam Mahmood, Doina Precup, Pan Xu
2024	A*	`conf`	Nash Learning from Human Feedback. ICML Rémi Munos, Michal Valko, Daniele Calandriello, Mohammad Gheshlaghi Azar, Mark Rowland, Daniel Guo, Yunhao Tang, Matthieu Geist, Thomas Mesnard, Côme Fiegel, Andrea Michi, Marco Selvi, Sertan Girgin, Nikola Momchev, Olivier Bachem, Daniel J. Mankowitz, Doina Precup, Bilal Piot
2024	A*	`conf`	Offline Multitask Representation Learning for Reinforcement Learning. NeurIPS Haque Ishfaq, Thanh Nguyen-Tang, Songtao Feng, Raman Arora, Mengdi Wang, Ming Yin, Doina Precup
2024	J	`jnl`	Offline Multitask Representation Learning for Reinforcement Learning. CoRR Haque Ishfaq, Thanh Nguyen-Tang, Songtao Feng, Raman Arora, Mengdi Wang, Ming Yin, Doina Precup
2024	A	`conf`	On learning history-based policies for controlling Markov decision processes. AISTATS Gandharv Patil, Aditya Mahajan, Doina Precup
2024	J	`jnl`	On the Limits of Multi-modal Meta-Learning with Auxiliary Task Modulation Using Conditional Batch Normalization. CoRR Jordi Armengol-Estapé, Vincent Michalski, Ramnath Kumar, Pierre-Luc St-Charles, Doina Precup, Samira Ebrahimi Kahou
2024	A	`conf`	On the Privacy of Selection Mechanisms with Gaussian Noise. AISTATS Jonathan Lebensold, Doina Precup, Borja Balle
2024	J	`jnl`	On the Privacy of Selection Mechanisms with Gaussian Noise. CoRR Jonathan Lebensold, Doina Precup, Borja Balle
2024	A*	`conf`	Parseval Regularization for Continual Reinforcement Learning. NeurIPS Wesley Chung, Lynn Cherif, Doina Precup, David Meger
2024	J	`jnl`	Parseval Regularization for Continual Reinforcement Learning. CoRR Wesley Chung, Lynn Cherif, David Meger, Doina Precup
2024	—	`conf`	Partial Models for Building Adaptive Model-Based Reinforcement Learning Agents. CoLLAs Safa Alver, Ali Rahimi-Kalahroudi, Doina Precup
2024	J	`jnl`	Partial Models for Building Adaptive Model-Based Reinforcement Learning Agents. CoRR Safa Alver, Ali Rahimi-Kalahroudi, Doina Precup
2024	J	`jnl`	Policy Gradient Methods in the Presence of Symmetries and State Abstractions. J. Mach. Learn. Res. Prakash Panangaden, Sahand Rezaei-Shoshtari, Rosie Zhao, David Meger, Doina Precup
2024	A*	`conf`	Provable and Practical: Efficient Exploration in Reinforcement Learning via Langevin Monte Carlo. ICLR Haque Ishfaq, Qingfeng Lan, Pan Xu, A. Rupam Mahmood, Doina Precup, Anima Anandkumar, Kamyar Azizzadenesheli
2024	A*	`conf`	QGFN: Controllable Greediness with Action Values. NeurIPS Elaine Lau, Stephen Zhewen Lu, Ling Pan, Doina Precup, Emmanuel Bengio
2024	J	`jnl`	QGFN: Controllable Greediness with Action Values. CoRR Elaine Lau, Stephen Zhewen Lu, Ling Pan, Doina Precup, Emmanuel Bengio
2024	A*	`conf`	ReactZyme: A Benchmark for Enzyme-Reaction Prediction. NeurIPS Chenqing Hua, Bozitao Zhong, Sitao Luan, Liang Hong, Guy Wolf, Doina Precup, Shuangjia Zheng
2024	J	`jnl`	Reaction-conditioned De Novo Enzyme Design with GENzyme. CoRR Chenqing Hua, Jiarui Lu, Yong Liu, Odin Zhang, Jian Tang, Rex Ying, Wengong Jin, Guy Wolf, Doina Precup, Shuangjia Zheng
2024	J	`jnl`	Reactzyme: A Benchmark for Enzyme-Reaction Prediction. CoRR Chenqing Hua, Bozitao Zhong, Sitao Luan, Liang Hong, Guy Wolf, Doina Precup, Shuangjia Zheng
2024	J	`jnl`	Soft Condorcet Optimization for Ranking of General Agents. CoRR Marc Lanctot, Kate Larson, Michael Kaisers, Quentin Berthet, Ian Gemp, Manfred Diaz, Roberto-Rafael Maura-Rivero, Yoram Bachrach, Anna Koop, Doina Precup
2024	J	`jnl`	The Heterophilic Graph Learning Handbook: Benchmarks, Models, Theoretical Analysis, Applications and Challenges. CoRR Sitao Luan, Chenqing Hua, Qincheng Lu, Liheng Ma, Lirong Wu, Xinyu Wang, Minkai Xu, Xiao-Wen Chang, Doina Precup, Rex Ying, Stan Z. Li, Jian Tang, Guy Wolf, Stefanie Jegelka
2024	J	`jnl`	Training Language Models to Self-Correct via Reinforcement Learning. CoRR Aviral Kumar, Vincent Zhuang, Rishabh Agarwal, Yi Su, John D. Co-Reyes, Avi Singh, Kate Baumli, Shariq Iqbal, Colton Bishop, Rebecca Roelofs, Lei M. Zhang, Kay McKinney, Disha Shrivastava, Cosmin Paduraru, George Tucker, Doina Precup, Feryal M. P. Behbahani, Aleksandra Faust
2023	A*	`conf`	A Definition of Continual Reinforcement Learning. NeurIPS David Abel, André Barreto, Benjamin Van Roy, Doina Precup, Hado Philip van Hasselt, Satinder Singh
2023	J	`jnl`	A Definition of Continual Reinforcement Learning. CoRR David Abel, André Barreto, Benjamin Van Roy, Doina Precup, Hado van Hasselt, Satinder Singh
2023	J	`jnl`	A cry for help: Early detection of brain injury in newborns. CoRR Charles C. Onu, Samantha Latremouille, Arsenii Gorin, Junhao Wang, Uchenna Ekwochi, Peter O. Ubuane, Omolara A. Kehinde, Muhammad A. Salisu, Datonye Briggs, Yoshua Bengio, Doina Precup
2023	J	`jnl`	Accelerating exploration and representation learning with offline pre-training. CoRR Bogdan Mazoure, Jake Bruce, Doina Precup, Rob Fergus, Ankit Anand
2023	J	`jnl`	An Empirical Study of the Effectiveness of Using a Replay Buffer on Mode Discovery in GFlowNets. CoRR Nikhil Vemgal, Elaine Lau, Doina Precup
2023	J	`jnl`	Combining Spatial and Temporal Abstraction in Planning for Better Generalization. CoRR Mingde Zhao, Safa Alver, Harm van Seijen, Romain Laroche, Doina Precup, Yoshua Bengio
2023	J	`jnl`	Conditions on Preference Relations that Guarantee the Existence of Optimal Policies. CoRR Jonathan Colaço Carr, Prakash Panangaden, Doina Precup
2023	—	`ed.`	Conference on Lifelong Learning Agents, 22-25 August 2023, McGill University, Montréal, Québec, Canada. CoLLAs Sarath Chandar, Razvan Pascanu, Hanie Sedghi, Doina Precup
2023	J	`jnl`	DGFN: Double Generative Flow Networks. CoRR Elaine Lau, Nikhil Vemgal, Doina Precup, Emmanuel Bengio
2023	J	`jnl`	Finding Increasingly Large Extremal Graphs with AlphaZero and Tabu Search. CoRR Abbas Mehrabian, Ankit Anand, Hyunjik Kim, Nicolas Sonnerat, Matej Balog, Gheorghe Comanici, Tudor Berariu, Andrew Lee, Anian Ruoss, Anna Bulanova, Daniel Toyama, Sam Blackwell, Bernardino Romera-Paredes, Petar Velickovic, Laurent Orseau, Joonkyung Lee, Anurag Murty Naredla, Doina Precup, Adam Zsolt Wagner
2023	A	`conf`	Finite time analysis of temporal difference learning with linear function approximation: Tail averaging and regularisation. AISTATS Gandharv Patil, Prashanth L. A., Dheeraj Nagaraj, Doina Precup
2023	A*	`conf`	For SALE: State-Action Representation Learning for Deep Reinforcement Learning. NeurIPS Scott Fujimoto, Wei-Di Chang, Edward J. Smith, Shixiang Gu, Doina Precup, David Meger
2023	J	`jnl`	For SALE: State-Action Representation Learning for Deep Reinforcement Learning. CoRR Scott Fujimoto, Wei-Di Chang, Edward J. Smith, Shixiang Shane Gu, Doina Precup, David Meger
2023	J	`jnl`	Forecaster: Towards Temporally Abstract Tree-Search Planning from Pixels. CoRR Thomas Jiralerspong, Flemming Kondrup, Doina Precup, Khimya Khetarpal
2023	—	`conf`	Hybrid Scattering Transform - Long Short-Term Memory Networks for Intrapartum Fetal Heart Rate Classification. CinC Derek Kweku Degbedzui, Michael Kuzniewicz, Marie-Coralie Cornet, Yvonne Wu, Heather Forquer, Lawrence Gerstley, Emily F. Hamilton, Doina Precup, Philip A. Warrick, Robert E. Kearney
2023	—	`conf`	MUDiff: Unified Diffusion for Complete Molecule Generation. LoG Chenqing Hua, Sitao Luan, Minkai Xu, Zhitao Ying, Jie Fu, Stefano Ermon, Doina Precup
2023	J	`jnl`	MUDiff: Unified Diffusion for Complete Molecule Generation. CoRR Chenqing Hua, Sitao Luan, Minkai Xu, Rex Ying, Jie Fu, Stefano Ermon, Doina Precup
2023	J	`jnl`	Membership Inference Attacks Against Temporally Correlated Data in Deep Reinforcement Learning. IEEE Access Maziar Gomrokchi, Susan Amin, Hossein Aboutalebi, Alexander Wong, Doina Precup
2023	—	`conf`	Minimal Value-Equivalent Partial Models for Scalable and Robust Planning in Lifelong Reinforcement Learning. CoLLAs Safa Alver, Doina Precup
2023	J	`jnl`	Minimal Value-Equivalent Partial Models for Scalable and Robust Planning in Lifelong Reinforcement Learning. CoRR Safa Alver, Doina Precup
2023	A*	`conf`	Multi-Environment Pretraining Enables Transfer to Action Limited Datasets. ICML David Venuto, Sherry Yang, Pieter Abbeel, Doina Precup, Igor Mordatch, Ofir Nachum
2023	J	`jnl`	Nash Learning from Human Feedback. CoRR Rémi Munos, Michal Valko, Daniele Calandriello, Mohammad Gheshlaghi Azar, Mark Rowland, Zhaohan Daniel Guo, Yunhao Tang, Matthieu Geist, Thomas Mesnard, Andrea Michi, Marco Selvi, Sertan Girgin, Nikola Momchev, Olivier Bachem, Daniel J. Mankowitz, Doina Precup, Bilal Piot
2023	A*	`conf`	On the Challenges of Using Reinforcement Learning in Precision Drug Dosing: Delay and Prolongedness of Action Effects. AAAI Sumana Basu, Marc-André Legault, Adriana Romero-Soriano, Doina Precup
2023	J	`jnl`	On the Challenges of using Reinforcement Learning in Precision Drug Dosing: Delay and Prolongedness of Action Effects. CoRR Sumana Basu, Marc-André Legault, Adriana Romero-Soriano, Doina Precup
2023	J	`jnl`	On the Convergence of Bounded Agents. CoRR David Abel, André Barreto, Hado van Hasselt, Benjamin Van Roy, Doina Precup, Satinder Singh
2023	J	`jnl`	Optimism and Adaptivity in Policy Optimization. CoRR Veronica Chelu, Tom Zahavy, Arthur Guez, Doina Precup, Sebastian Flennerhag
2023	J	`jnl`	Policy Gradient Methods in the Presence of Symmetries and State Abstractions. CoRR Prakash Panangaden, Sahand Rezaei-Shoshtari, Rosie Zhao, David Meger, Doina Precup
2023	J	`jnl`	Policy composition in reinforcement learning via multi-objective policy optimization. CoRR Shruti Mishra, Ankit Anand, Jordan Hoffmann, Nicolas Heess, Martin A. Riedmiller, Abbas Abdolmaleki, Doina Precup
2023	A*	`conf`	Prediction and Control in Continual Reinforcement Learning. NeurIPS Nishanth Anand, Doina Precup
2023	J	`jnl`	Prediction and Control in Continual Reinforcement Learning. CoRR Nishanth Anand, Doina Precup
2023	J	`jnl`	Provable and Practical: Efficient Exploration in Reinforcement Learning via Langevin Monte Carlo. CoRR Haque Ishfaq, Qingfeng Lan, Pan Xu, A. Rupam Mahmood, Doina Precup, Anima Anandkumar, Kamyar Azizzadenesheli
2023	J	`jnl`	Temporal Abstraction in Reinforcement Learning with the Successor Representation. J. Mach. Learn. Res. Marlos C. Machado, André Barreto, Doina Precup, Michael Bowling
2023	J	`jnl`	The Stable Entropy Hypothesis and Entropy-Aware Decoding: An Analysis and Algorithm for Robust Natural Language Generation. CoRR Kushal Arora, Timothy J. O'Donnell, Doina Precup, Jason Weston, Jackie Chi Kit Cheung
2023	A*	`conf`	Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning. AAAI Flemming Kondrup, Thomas Jiralerspong, Elaine Lau, Nathan de Lara, Jacob Shkrob, My Duc Tran, Doina Precup, Sumana Basu
2023	—	`conf`	Training Matters: Unlocking Potentials of Deeper Graph Convolutional Neural Networks. COMPLEX NETWORKS (1) Sitao Luan, Mingde Zhao, Xiao-Wen Chang, Doina Precup
2023	J	`jnl`	When Do Graph Neural Networks Help with Node Classification: Investigating the Homophily Principle on Node Distinguishability. CoRR Sitao Luan, Chenqing Hua, Minkai Xu, Qincheng Lu, Jiaqi Zhu, Xiao-Wen Chang, Jie Fu, Jure Leskovec, Doina Precup
2023	A*	`conf`	When Do Graph Neural Networks Help with Node Classification? Investigating the Homophily Principle on Node Distinguishability. NeurIPS Sitao Luan, Chenqing Hua, Minkai Xu, Qincheng Lu, Jiaqi Zhu, Xiao-Wen Chang, Jie Fu, Jure Leskovec, Doina Precup
2023	—	`conf`	When Do We Need Graph Neural Networks for Node Classification? COMPLEX NETWORKS (1) Sitao Luan, Chenqing Hua, Qincheng Lu, Jiaqi Zhu, Xiao-Wen Chang, Doina Precup
2022	—	`conf`	Assessing Intrapartum Risk of Hypoxic Ischemic Encephalopathy Using Fetal Heart Rate With Long Short-Term Memory Networks. CinC Derek Kweku Degbedzui, Michael Kuzniewicz, Marie-Coralie Cornet, Yvonne Wu, Heather Forquer, Lawrence Gerstley, Emily F. Hamilton, Doina Precup, Philip A. Warrick, Robert E. Kearney
2022	J	`jnl`	Attention Option-Critic. CoRR Raviteja Chunduru, Doina Precup
2022	J	`jnl`	Bayesian Q-learning With Imperfect Expert Demonstrations. CoRR Fengdi Che, Xiru Zhu, Doina Precup, David Meger, Gregory Dudek
2022	J	`jnl`	Behind the Machine's Gaze: Biologically Constrained Neural Networks Exhibit Human-like Visual Attention. CoRR Leo Schwinn, Doina Precup, Björn M. Eskofier, Dario Zanca
2022	J	`jnl`	Behind the Machine's Gaze: Neural Networks with Biologically-inspired Constraints Exhibit Human-like Visual Attention. Trans. Mach. Learn. Res. Leo Schwinn, Doina Precup, Björn M. Eskofier, Dario Zanca
2022	A*	`conf`	COptiDICE: Offline Constrained Reinforcement Learning via Stationary Distribution Correction Estimation. ICLR Jongmin Lee, Cosmin Paduraru, Daniel J. Mankowitz, Nicolas Heess, Doina Precup, Kee-Eung Kim, Arthur Guez
2022	J	`jnl`	COptiDICE: Offline Constrained Reinforcement Learning via Stationary Distribution Correction Estimation. CoRR Jongmin Lee, Cosmin Paduraru, Daniel J. Mankowitz, Nicolas Heess, Doina Precup, Kee-Eung Kim, Arthur Guez
2022	J	`jnl`	Complete the Missing Half: Augmenting Aggregation Filtering with Diversification for Graph Convolutional Neural Networks. CoRR Sitao Luan, Mingde Zhao, Chenqing Hua, Xiao-Wen Chang, Doina Precup
2022	—	`ed.`	Conference on Lifelong Learning Agents, CoLLAs 2022, 22-24 August 2022, McGill University, Montréal, Québec, Canada. CoLLAs Sarath Chandar, Razvan Pascanu, Doina Precup
2022	A*	`conf`	Constructing a Good Behavior Basis for Transfer using Generalized Policy Updates. ICLR Safa Alver, Doina Precup
2022	A*	`conf`	Continuous MDP Homomorphisms and Homomorphic Policy Gradient. NeurIPS Sahand Rezaei-Shoshtari, Rosie Zhao, Prakash Panangaden, David Meger, Doina Precup
2022	J	`jnl`	Continuous MDP Homomorphisms and Homomorphic Policy Gradient. CoRR Sahand Rezaei-Shoshtari, Rosie Zhao, Prakash Panangaden, David Meger, Doina Precup
2022	J	`jnl`	Deep learning, reinforcement learning, and world models. Neural Networks Yutaka Matsuo, Yann LeCun, Maneesh Sahani, Doina Precup, David Silver, Masashi Sugiyama, Eiji Uchibe, Jun Morimoto
2022	J	`jnl`	Finite time analysis of temporal difference learning with linear function approximation: Tail averaging and regularisation. CoRR Gandharv Patil, Prashanth L. A., Dheeraj Nagaraj, Doina Precup
2022	A*	`conf`	Improving Robustness against Real-World and Worst-Case Distribution Shifts through Decision Region Quantification. ICML Leo Schwinn, Leon Bungert, An Nguyen, René Raab, Falk Pulsmeyer, Doina Precup, Bjoern M. Eskofier, Dario Zanca
2022	J	`jnl`	Improving Robustness against Real-World and Worst-Case Distribution Shifts through Decision Region Quantification. CoRR Leo Schwinn, Leon Bungert, An Nguyen, René Raab, Falk Pulsmeyer, Doina Precup, Björn M. Eskofier, Dario Zanca
2022	J	`jnl`	Improving Sample Efficiency of Value Based Models Using Attention and Vision Transformers. CoRR Amir Ardalan Kalantari, Mohammad Amini, Sarath Chandar, Doina Precup
2022	J	`jnl`	Learning how to Interact with a Complex Interface using Hierarchical Reinforcement Learning. CoRR Gheorghe Comanici, Amelia Glaese, Anita Gergely, Daniel Toyama, Zafarali Ahmed, Tyler Jackson, Philippe Hamel, Doina Precup
2022	J	`jnl`	Low-Rank Representation of Reinforcement Learning Policies. J. Artif. Intell. Res. Bogdan Mazoure, Thang Doan, Tianyu Li, Vladimir Makarenkov, Joelle Pineau, Doina Precup, Guillaume Rabusseau
2022	J	`jnl`	Multi-Environment Pretraining Enables Transfer to Action Limited Datasets. CoRR David Venuto, Sherry Yang, Pieter Abbeel, Doina Precup, Igor Mordatch, Ofir Nachum
2022	J	`jnl`	Offline Policy Optimization in RL with Variance Regularizaton. CoRR Riashat Islam, Samarth Sinha, Homanga Bharadhwaj, Samin Yeasar Arnob, Zhuoran Yang, Animesh Garg, Zhaoran Wang, Lihong Li, Doina Precup
2022	J	`jnl`	On learning history based policies for controlling Markov decision processes. CoRR Gandharv Patil, Aditya Mahajan, Doina Precup
2022	A*	`conf`	On the Expressivity of Markov Reward (Extended Abstract). IJCAI David Abel, Will Dabney, Anna Harutyunyan, Mark K. Ho, Michael L. Littman, Doina Precup, Satinder Singh
2022	J	`jnl`	PhyloPGM: boosting regulatory function prediction accuracy using evolutionary information. Bioinform. Faizy Ahsan, Zichao Yan, Doina Precup, Mathieu Blanchette
2022	A*	`conf`	Policy Gradients Incorporating the Future. ICLR David Venuto, Elaine Lau, Doina Precup, Ofir Nachum
2022	A*	`conf`	Proving Theorems using Incremental Learning and Hindsight Experience Replay. ICML Eser Aygün, Ankit Anand, Laurent Orseau, Xavier Glorot, Stephen Marcus McAleer, Vlad Firoiu, Lei M. Zhang, Doina Precup, Shibl Mourad
2022	A*	`conf`	Revisiting Heterophily For Graph Neural Networks. NeurIPS Sitao Luan, Chenqing Hua, Qincheng Lu, Jiaqi Zhu, Mingde Zhao, Shuyuan Zhang, Xiao-Wen Chang, Doina Precup
2022	J	`jnl`	Revisiting Heterophily For Graph Neural Networks. CoRR Sitao Luan, Chenqing Hua, Qincheng Lu, Jiaqi Zhu, Mingde Zhao, Shuyuan Zhang, Xiao-Wen Chang, Doina Precup
2022	J	`jnl`	Selective Credit Assignment. CoRR Veronica Chelu, Diana Borsa, Doina Precup, Hado van Hasselt
2022	J	`jnl`	Simulating Human Gaze with Neural Visual Attention. CoRR Leo Schwinn, Doina Precup, Björn M. Eskofier, Dario Zanca
2022	J	`jnl`	The Paradox of Choice: Using Attention in Hierarchical Reinforcement Learning. CoRR Andrei Cristian Nica, Khimya Khetarpal, Doina Precup
2022	J	`jnl`	Towards Continual Reinforcement Learning: A Review and Perspectives. J. Artif. Intell. Res. Khimya Khetarpal, Matthew Riemer, Irina Rish, Doina Precup
2022	J	`jnl`	Towards Painless Policy Optimization for Constrained MDPs. CoRR Arushi Jain, Sharan Vaswani, Reza Babanezhad, Csaba Szepesvári, Doina Precup
2022	J	`jnl`	Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning. CoRR Flemming Kondrup, Thomas Jiralerspong, Elaine Lau, Nathan de Lara, Jacob Shkrob, My Duc Tran, Doina Precup, Sumana Basu
2022	A	`conf`	Towards painless policy optimization for constrained MDPs. UAI Arushi Jain, Sharan Vaswani, Reza Babanezhad, Csaba Szepesváari, Doina Precup
2022	J	`jnl`	Understanding Decision-Time vs. Background Planning in Model-Based Reinforcement Learning. CoRR Safa Alver, Doina Precup
2022	J	`jnl`	When Do We Need GNN for Node Classification? CoRR Sitao Luan, Chenqing Hua, Qincheng Lu, Jiaqi Zhu, Xiao-Wen Chang, Doina Precup
2022	A*	`conf`	Why Should I Trust You, Bellman? The Bellman Error is a Poor Replacement for Value Error. ICML Scott Fujimoto, David Meger, Doina Precup, Ofir Nachum, Shixiang Shane Gu
2022	J	`jnl`	Why Should I Trust You, Bellman? The Bellman Error is a Poor Replacement for Value Error. CoRR Scott Fujimoto, David Meger, Doina Precup, Ofir Nachum, Shixiang Shane Gu
2021	A*	`conf`	A Consciousness-Inspired Planning Agent for Model-Based Reinforcement Learning. NeurIPS Mingde Zhao, Zhen Liu, Sitao Luan, Shuyuan Zhang, Doina Precup, Yoshua Bengio
2021	J	`jnl`	A Consciousness-Inspired Planning Agent for Model-Based Reinforcement Learning. CoRR Mingde Zhao, Zhen Liu, Sitao Luan, Shuyuan Zhang, Doina Precup, Yoshua Bengio
2021	A*	`conf`	A Deep Reinforcement Learning Approach to Marginalized Importance Sampling with the Successor Representation. ICML Scott Fujimoto, David Meger, Doina Precup
2021	J	`jnl`	A Deep Reinforcement Learning Approach to Marginalized Importance Sampling with the Successor Representation. CoRR Scott Fujimoto, David Meger, Doina Precup
2021	J	`jnl`	A Survey of Exploration Methods in Reinforcement Learning. CoRR Susan Amin, Maziar Gomrokchi, Harsh Satija, Herke van Hoof, Doina Precup
2021	J	`jnl`	AndroidEnv: A Reinforcement Learning Platform for Android. CoRR Daniel Toyama, Philippe Hamel, Anita Gergely, Gheorghe Comanici, Amelia Glaese, Zafarali Ahmed, Tyler Jackson, Shibl Mourad, Doina Precup
2021	J	`jnl`	Constructing a Good Behavior Basis for Transfer using Generalized Policy Updates. CoRR Safa Alver, Doina Precup
2021	J	`jnl`	Correcting Momentum in Temporal Difference Learning. CoRR Emmanuel Bengio, Joelle Pineau, Doina Precup
2021	A*	`conf`	Flexible Option Learning. NeurIPS Martin Klissarov, Doina Precup
2021	J	`jnl`	Flexible Option Learning. CoRR Martin Klissarov, Doina Precup
2021	A*	`conf`	Flow Network based Generative Models for Non-Iterative Diverse Candidate Generation. NeurIPS Emmanuel Bengio, Moksh Jain, Maksym Korablyov, Doina Precup, Yoshua Bengio
2021	J	`jnl`	Flow Network based Generative Models for Non-Iterative Diverse Candidate Generation. CoRR Emmanuel Bengio, Moksh Jain, Maksym Korablyov, Doina Precup, Yoshua Bengio
2021	A*	`conf`	Gradient Starvation: A Learning Proclivity in Neural Networks. NeurIPS Mohammad Pezeshki, Sékou-Oumar Kaba, Yoshua Bengio, Aaron C. Courville, Doina Precup, Guillaume Lajoie
2021	J	`jnl`	Importance of Empirical Sample Complexity Analysis for Offline Reinforcement Learning. CoRR Samin Yeasar Arnob, Riashat Islam, Doina Precup
2021	J	`jnl`	Improving Long-Term Metrics in Recommendation Systems using Short-Horizon Offline RL. CoRR Bogdan Mazoure, Paul Mineiro, Pavithra Srinath, Reza Sharifi Sedeh, Doina Precup, Adith Swaminathan
2021	J	`jnl`	Is Heterophily A Real Nightmare For Graph Neural Networks To Do Node Classification? CoRR Sitao Luan, Chenqing Hua, Qincheng Lu, Jiaqi Zhu, Mingde Zhao, Shuyuan Zhang, Xiao-Wen Chang, Doina Precup
2021	A*	`conf`	Locally Persistent Exploration in Continuous Control Tasks with Sparse Rewards. ICML Susan Amin, Maziar Gomrokchi, Hossein Aboutalebi, Harsh Satija, Doina Precup
2021	A*	`conf`	On the Expressivity of Markov Reward. NeurIPS David Abel, Will Dabney, Anna Harutyunyan, Mark K. Ho, Michael L. Littman, Doina Precup, Satinder Singh
2021	J	`jnl`	On the Expressivity of Markov Reward. CoRR David Abel, Will Dabney, Anna Harutyunyan, Mark K. Ho, Michael L. Littman, Doina Precup, Satinder Singh
2021	A*	`conf`	Optimal Spectral-Norm Approximate Minimization of Weighted Finite Automata. ICALP Borja Balle, Clara Lacroce, Prakash Panangaden, Doina Precup, Guillaume Rabusseau
2021	J	`jnl`	Optimal Spectral-Norm Approximate Minimization of Weighted Finite Automata. CoRR Borja Balle, Clara Lacroce, Prakash Panangaden, Doina Precup, Guillaume Rabusseau
2021	J	`jnl`	Policy Gradients Incorporating the Future. CoRR David Venuto, Elaine Lau, Doina Precup, Ofir Nachum
2021	A*	`conf`	Preferential Temporal Difference Learning. ICML Nishanth V. Anand, Doina Precup
2021	J	`jnl`	Preferential Temporal Difference Learning. CoRR Nishanth Anand, Doina Precup
2021	J	`jnl`	Proving Theorems using Incremental Learning and Hindsight Experience Replay. CoRR Eser Aygün, Laurent Orseau, Ankit Anand, Xavier Glorot, Vlad Firoiu, Lei M. Zhang, Doina Precup, Shibl Mourad
2021	J	`jnl`	Randomized Exploration for Reinforcement Learning with General Value Function Approximation. CoRR Haque Ishfaq, Qiwen Cui, Viet Nguyen, Alex Ayoub, Zhuoran Yang, Zhaoran Wang, Doina Precup, Lin F. Yang
2021	A*	`conf`	Randomized Exploration in Reinforcement Learning with General Value Function Approximation. ICML Haque Ishfaq, Qiwen Cui, Viet Nguyen, Alex Ayoub, Zhuoran Yang, Zhaoran Wang, Doina Precup, Lin Yang
2021	J	`jnl`	Reward is enough. Artif. Intell. David Silver, Satinder Singh, Doina Precup, Richard S. Sutton
2021	J	`jnl`	Safe option-critic: learning safety in the option-critic architecture. Knowl. Eng. Rev. Arushi Jain, Khimya Khetarpal, Doina Precup
2021	A*	`conf`	Self-Supervised Attention-Aware Reinforcement Learning. AAAI Haiping Wu, Khimya Khetarpal, Doina Precup
2021	J	`jnl`	Single-Shot Pruning for Offline Reinforcement Learning. CoRR Samin Yeasar Arnob, Riyasat Ohib, Sergey M. Plis, Doina Precup
2021	J	`jnl`	Temporal Abstraction in Reinforcement Learning with the Successor Representation. CoRR Marlos C. Machado, André Barreto, Doina Precup
2021	A*	`conf`	Temporally Abstract Partial Models. NeurIPS Khimya Khetarpal, Zafarali Ahmed, Gheorghe Comanici, Doina Precup
2021	J	`jnl`	Temporally Abstract Partial Models. CoRR Khimya Khetarpal, Zafarali Ahmed, Gheorghe Comanici, Doina Precup
2021	J	`jnl`	The Option Keyboard: Combining Skills in Reinforcement Learning. CoRR André Barreto, Diana Borsa, Shaobo Hou, Gheorghe Comanici, Eser Aygün, Philippe Hamel, Daniel Toyama, Jonathan J. Hunt, Shibl Mourad, David Silver, Doina Precup
2021	J	`jnl`	Training a First-Order Theorem Prover from Synthetic Data. CoRR Vlad Firoiu, Eser Aygün, Ankit Anand, Zafarali Ahmed, Xavier Glorot, Laurent Orseau, Lei M. Zhang, Doina Precup, Shibl Mourad
2021	A*	`conf`	Variance Penalized On-Policy and Off-Policy Actor-Critic. AAAI Arushi Jain, Gandharv Patil, Ayush Jain, Khimya Khetarpal, Doina Precup
2021	J	`jnl`	Variance Penalized On-Policy and Off-Policy Actor-Critic. CoRR Arushi Jain, Gandharv Patil, Ayush Jain, Khimya Khetarpal, Doina Precup
2021	J	`jnl`	What is Going on Inside Recurrent Meta Reinforcement Learning Agents? CoRR Safa Alver, Doina Precup
2021	J	`jnl`	Where Did You Learn That From? Surprising Effectiveness of Membership Inference Attacks Against Temporally Correlated Data in Deep Reinforcement Learning. CoRR Maziar Gomrokchi, Susan Amin, Hossein Aboutalebi, Alexander Wong, Doina Precup
2020	J	`jnl`	A Brief Look at Generalization in Visual Meta-Reinforcement Learning. CoRR Safa Alver, Doina Precup
2020	A	`conf`	A Distributional Analysis of Sampling-Based Reinforcement Learning Algorithms. AISTATS Philip Amortila, Doina Precup, Prakash Panangaden, Marc G. Bellemare
2020	J	`jnl`	A Distributional Analysis of Sampling-Based Reinforcement Learning Algorithms. CoRR Philip Amortila, Doina Precup, Prakash Panangaden, Marc G. Bellemare
2020	J	`jnl`	A Fully Tensorized Recurrent Neural Network. CoRR Charles C. Onu, Jacob E. Miller, Doina Precup
2020	J	`jnl`	A Study of Policy Gradient on a Class of Exactly Solvable Models. CoRR Gavin McCracken, Colin Daniels, Rosie Zhao, Anna M. Brandenberger, Prakash Panangaden, Doina Precup
2020	A*	`conf`	Algorithmic Improvements for Deep Reinforcement Learning Applied to Interactive Fiction. AAAI Vishal Jain, William Fedus, Hugo Larochelle, Doina Precup, Marc G. Bellemare
2020	A*	`conf`	An Equivalence between Loss Functions and Non-Uniform Sampling in Experience Replay. NeurIPS Scott Fujimoto, David Meger, Doina Precup
2020	J	`jnl`	An Equivalence between Loss Functions and Non-Uniform Sampling in Experience Replay. CoRR Scott Fujimoto, David Meger, Doina Precup
2020	J	`jnl`	Complete the Missing Half: Augmenting Aggregation Filtering with Diversification for Graph Convolutional Networks. CoRR Sitao Luan, Mingde Zhao, Chenqing Hua, Xiao-Wen Chang, Doina Precup
2020	J	`jnl`	Connecting Weighted Automata, Tensor Networks and Recurrent Neural Networks through Spectral Learning. CoRR Tianyu Li, Doina Precup, Guillaume Rabusseau
2020	J	`jnl`	Diversity-Enriched Option-Critic. CoRR Anand Kamat, Doina Precup
2020	A	`conf`	Efficient Planning under Partial Observability with Unnormalized Q Functions and Spectral Learning. AISTATS Tianyu Li, Bogdan Mazoure, Doina Precup, Guillaume Rabusseau
2020	J	`jnl`	Exploring uncertainty measures in deep networks for Multiple sclerosis lesion detection and segmentation. Medical Image Anal. Tanya Nair, Doina Precup, Douglas L. Arnold, Tal Arbel
2020	J	`jnl`	Fast reinforcement learning with generalized policy updates. Proc. Natl. Acad. Sci. USA André Barreto, Shaobo Hou, Diana Borsa, David Silver, Doina Precup
2020	A*	`conf`	Forethought and Hindsight in Credit Assignment. NeurIPS Veronica Chelu, Doina Precup, Hado van Hasselt
2020	J	`jnl`	Forethought and Hindsight in Credit Assignment. CoRR Veronica Chelu, Doina Precup, Hado van Hasselt
2020	A*	`conf`	Gifting in Multi-Agent Reinforcement Learning (Student Abstract). AAAI Andrei Lupu, Doina Precup
2020	A	`conf`	Gifting in Multi-Agent Reinforcement Learning. AAMAS Andrei Lupu, Doina Precup
2020	J	`jnl`	Gradient Starvation: A Learning Proclivity in Neural Networks. CoRR Mohammad Pezeshki, Sékou-Oumar Kaba, Yoshua Bengio, Aaron C. Courville, Doina Precup, Guillaume Lajoie
2020	A*	`conf`	Interference and Generalization in Temporal Difference Learning. ICML Emmanuel Bengio, Joelle Pineau, Doina Precup
2020	J	`jnl`	Interference and Generalization in Temporal Difference Learning. CoRR Emmanuel Bengio, Joelle Pineau, Doina Precup
2020	A*	`conf`	Invariant Causal Prediction for Block MDPs. ICML Amy Zhang, Clare Lyle, Shagun Sodhani, Angelos Filos, Marta Kwiatkowska, Joelle Pineau, Yarin Gal, Doina Precup
2020	J	`jnl`	Invariant Causal Prediction for Block MDPs. CoRR Amy Zhang, Clare Lyle, Shagun Sodhani, Angelos Filos, Marta Kwiatkowska, Joelle Pineau, Yarin Gal, Doina Precup
2020	B	`conf`	Keynote Lecture - Building Knowledge For AI AgentsWith Reinforcement Learning. ICCP Doina Precup
2020	J	`jnl`	Learning to Prove from Synthetic Theorems. CoRR Eser Aygün, Zafarali Ahmed, Ankit Anand, Vlad Firoiu, Xavier Glorot, Laurent Orseau, Doina Precup, Shibl Mourad
2020	B	`conf`	Learning to cooperate: Emergent communication in multi-agent navigation. CogSci Ivana Kajic, Eser Aygün, Doina Precup
2020	J	`jnl`	Learning to cooperate: Emergent communication in multi-agent navigation. CoRR Ivana Kajic, Eser Aygün, Doina Precup
2020	J	`jnl`	Locally Persistent Exploration in Continuous Control Tasks with Sparse Rewards. CoRR Susan Amin, Maziar Gomrokchi, Hossein Aboutalebi, Harsh Satija, Doina Precup
2020	A	`conf`	META-Learning State-based Eligibility Traces for More Sample-Efficient Policy Evaluation. AAMAS Mingde Zhao, Sitao Luan, Ian Porada, Xiao-Wen Chang, Doina Precup
2020	J	`jnl`	Multiple Kernel Learning-Based Transfer Regression for Electric Load Forecasting. IEEE Trans. Smart Grid Di Wu, Boyu Wang, Doina Precup, Benoit Boulet
2020	A*	`conf`	On Efficiency in Hierarchical Reinforcement Learning. NeurIPS Zheng Wen, Doina Precup, Morteza Ibrahimi, André Barreto, Benjamin Van Roy, Satinder Singh
2020	A	`conf`	Option-Critic in Cooperative Multi-agent Systems. AAMAS Jhelum Chakravorty, Patrick Nadeem Ward, Julien Roy, Maxime Chevalier-Boisvert, Sumana Basu, Andrei Lupu, Doina Precup
2020	A*	`conf`	Options of Interest: Temporal Abstraction with Interest Functions. AAAI Khimya Khetarpal, Martin Klissarov, Maxime Chevalier-Boisvert, Pierre-Luc Bacon, Doina Precup
2020	J	`jnl`	Options of Interest: Temporal Abstraction with Interest Functions. CoRR Khimya Khetarpal, Martin Klissarov, Maxime Chevalier-Boisvert, Pierre-Luc Bacon, Doina Precup
2020	—	`conf`	Phylogenetic Manifold Regularization: A semi-supervised approach to predict transcription factor binding sites. BIBM Faizy Ahsan, Alexandre Drouin, François Laviolette, Doina Precup, Mathieu Blanchette
2020	J	`jnl`	Policy Evaluation Networks. CoRR Jean Harb, Tom Schaul, Doina Precup, Pierre-Luc Bacon
2020	J	`jnl`	Provably efficient reconstruction of policy networks. CoRR Bogdan Mazoure, Thang Doan, Tianyu Li, Vladimir Makarenkov, Joelle Pineau, Doina Precup, Guillaume Rabusseau
2020	A*	`conf`	Reward Propagation Using Graph Convolutional Networks. NeurIPS Martin Klissarov, Doina Precup
2020	J	`jnl`	Reward Propagation Using Graph Convolutional Networks. CoRR Martin Klissarov, Doina Precup
2020	A*	`conf`	SVRG for Policy Evaluation with Fewer Gradient Evaluations. IJCAI Zilun Peng, Ahmed Touati, Pascal Vincent, Doina Precup
2020	J	`jnl`	Towards Continual Reinforcement Learning: A Review and Perspectives. CoRR Khimya Khetarpal, Matthew Riemer, Irina Rish, Doina Precup
2020	J	`jnl`	Training Matters: Unlocking Potentials of Deeper Graph Convolutional Neural Networks. CoRR Sitao Luan, Mingde Zhao, Xiao-Wen Chang, Doina Precup
2020	A	`conf`	Value Preserving State-Action Abstractions. AISTATS David Abel, Nate Umbanhowar, Khimya Khetarpal, Dilip Arumugam, Doina Precup, Michael L. Littman
2020	A*	`conf`	Value-driven Hindsight Modelling. NeurIPS Arthur Guez, Fabio Viola, Theophane Weber, Lars Buesing, Steven Kapturowski, Doina Precup, David Silver, Nicolas Heess
2020	J	`jnl`	Value-driven Hindsight Modelling. CoRR Arthur Guez, Fabio Viola, Théophane Weber, Lars Buesing, Steven Kapturowski, Doina Precup, David Silver, Nicolas Heess
2020	A*	`conf`	What can I do here? A Theory of Affordances in Reinforcement Learning. ICML Khimya Khetarpal, Zafarali Ahmed, Gheorghe Comanici, David Abel, Doina Precup
2020	J	`jnl`	What can I do here? A Theory of Affordances in Reinforcement Learning. CoRR Khimya Khetarpal, Zafarali Ahmed, Gheorghe Comanici, David Abel, Doina Precup
2020	J	`jnl`	oIRL: Robust Adversarial Inverse Reinforcement Learning with Temporally Extended Actions. CoRR David Venuto, Jhelum Chakravorty, Léonard Boussioux, Junhao Wang, Gavin McCracken, Doina Precup
2019	J	`jnl`	Actor Critic with Differentially Private Critic. CoRR Jonathan Lebensold, William L. Hamilton, Borja Balle, Doina Precup
2019	J	`jnl`	Algorithmic Improvements for Deep Reinforcement Learning applied to Interactive Fiction. CoRR Vishal Jain, William Fedus, Hugo Larochelle, Doina Precup, Marc G. Bellemare
2019	J	`jnl`	An Empirical Study of Batch Normalization and Group Normalization in Conditional Computation. CoRR Vincent Michalski, Vikram Voleti, Samira Ebrahimi Kahou, Anthony Ortiz, Pascal Vincent, Chris Pal, Doina Precup
2019	J	`jnl`	Augmenting learning using symmetry in a biologically-inspired domain. CoRR Shruti Mishra, Abbas Abdolmaleki, Arthur Guez, Piotr Trochim, Doina Precup
2019	J	`jnl`	Avoidance Learning Using Observational Reinforcement Learning. CoRR David Venuto, Léonard Boussioux, Junhao Wang, Rola Dali, Jhelum Chakravorty, Yoshua Bengio, Doina Precup
2019	A*	`conf`	Break the Ceiling: Stronger Multi-scale Deep Graph Convolutional Networks. NeurIPS Sitao Luan, Mingde Zhao, Xiao-Wen Chang, Doina Precup
2019	A	`conf`	Building Knowledge for AI Agents with Reinforcement Learning. AAMAS Doina Precup
2019	A*	`conf`	Combined Reinforcement Learning via Abstract Representations. AAAI Vincent François-Lavet, Yoshua Bengio, Doina Precup, Joelle Pineau
2019	—	`conf`	Community size effect in artificial learning systems. ViGIL@NeurIPS Olivier Tieleman, Angeliki Lazaridou, Shibl Mourad, Charles Blundell, Doina Precup
2019	A	`conf`	Connecting Weighted Automata and Recurrent Neural Networks through Spectral Learning. AISTATS Guillaume Rabusseau, Tianyu Li, Doina Precup
2019	J	`jnl`	Doubly Robust Off-Policy Actor-Critic Algorithms for Reinforcement Learning. CoRR Riashat Islam, Raihan Seraj, Samin Yeasar Arnob, Doina Precup
2019	—	`conf`	Early Prediction of Alzheimer's Disease Progression Using Variational Autoencoders. MICCAI (4) Sumana Basu, Konrad Wagstyl, Azar Zandifar, D. Louis Collins, Adriana Romero, Doina Precup
2019	J	`jnl`	Efficient Planning under Partial Observability with Unnormalized Q Functions and Spectral Learning. CoRR Tianyu Li, Bogdan Mazoure, Doina Precup, Guillaume Rabusseau
2019	J	`jnl`	Entropy Regularization with Discounted Future State Distribution in Policy Gradient Methods. CoRR Riashat Islam, Raihan Seraj, Pierre-Luc Bacon, Doina Precup
2019	A*	`conf`	Hindsight Credit Assignment. NeurIPS Anna Harutyunyan, Will Dabney, Thomas Mesnard, Mohammad Gheshlaghi Azar, Bilal Piot, Nicolas Heess, Hado van Hasselt, Gregory Wayne, Satinder Singh, Doina Precup, Rémi Munos
2019	J	`jnl`	Hindsight Credit Assignment. CoRR Anna Harutyunyan, Will Dabney, Thomas Mesnard, Mohammad Gheshlaghi Azar, Bilal Piot, Nicolas Heess, Hado van Hasselt, Greg Wayne, Satinder Singh, Doina Precup, Rémi Munos
2019	—	`conf`	Improving Pathological Structure Segmentation via Transfer Learning Across Diseases. DART/MIL3ID@MICCAI Barleen Kaur, Paul Lemaître, Raghav Mehta, Nazanin Mohammadi Sepahvand, Doina Precup, Douglas L. Arnold, Tal Arbel
2019	—	`conf`	Learning Modular Safe Policies in the Bandit Setting with Application to Adaptive Clinical Trials. AISafety@IJCAI Hossein Aboutalebi, Doina Precup, Tibor Schuster
2019	J	`jnl`	Learning Modular Safe Policies in the Bandit Setting with Application to Adaptive Clinical Trials. CoRR Hossein Aboutalebi, Doina Precup, Tibor Schuster
2019	A*	`conf`	Learning Options with Interest Functions. AAAI Khimya Khetarpal, Doina Precup
2019	—	`conf`	Learning Reliable Policies in the Bandit Setting with Application to Adaptive Clinical Trials. KDH@IJCAI Hossein Aboutalebi, Doina Precup, Tibor Schuster
2019	—	`conf`	Learning proposals for sequential importance samplers using reinforced variational inference. DeepRLStructPred@ICLR Zafarali Ahmed, Arjun Karuvally, Doina Precup, Simon Gravel
2019	A*	`conf`	Leveraging Observations in Bandits: Between Risks and Benefits. AAAI Andrei Lupu, Audrey Durand, Doina Precup
2019	J	`jnl`	Marginalized State Distribution Entropy Regularization in Policy Optimization. CoRR Riashat Islam, Zafarali Ahmed, Doina Precup
2019	Misc	`conf`	Navigation Agents for the Visually Impaired: A Sidewalk Simulator and Experiments. CoRL Martin Weiss, Simon Chamorro, Roger Girgis, Margaux Luck, Samira Ebrahimi Kahou, Joseph Paul Cohen, Derek Nowrouzezahrai, Doina Precup, Florian Golemo, Chris Pal
2019	J	`jnl`	Navigation Agents for the Visually Impaired: A Sidewalk Simulator and Experiments. CoRR Martin Weiss, Simon Chamorro, Roger Girgis, Margaux Luck, Samira Ebrahimi Kahou, Joseph Paul Cohen, Derek Nowrouzezahrai, Doina Precup, Florian Golemo, Chris Pal
2019	A	`conf`	Neural Transfer Learning for Cry-Based Diagnosis of Perinatal Asphyxia. INTERSPEECH Charles C. Onu, Jonathan Lebensold, William L. Hamilton, Doina Precup
2019	J	`jnl`	Neural Transfer Learning for Cry-based Diagnosis of Perinatal Asphyxia. CoRR Charles C. Onu, Jonathan Lebensold, William L. Hamilton, Doina Precup
2019	A*	`conf`	Off-Policy Deep Reinforcement Learning without Exploration. ICML Scott Fujimoto, David Meger, Doina Precup
2019	J	`jnl`	Option-critic in cooperative multi-agent systems. CoRR Jhelum Chakravorty, Patrick Nadeem Ward, Julien Roy, Maxime Chevalier-Boisvert, Sumana Basu, Andrei Lupu, Doina Precup
2019	A*	`conf`	Per-Decision Option Discounting. ICML Anna Harutyunyan, Peter Vrancx, Philippe Hamel, Ann Nowé, Doina Precup
2019	—	`conf`	Prediction of Disease Progression in Multiple Sclerosis Patients using Deep Learning Analysis of MRI Data. MIDL Adrian Tousignant, Paul Lemaître, Doina Precup, Douglas L. Arnold, Tal Arbel
2019	J	`jnl`	Recurrent Value Functions. CoRR Pierre Thodoroff, Nishanth Anand, Lucas Caccia, Doina Precup, Joelle Pineau
2019	J	`jnl`	Revisit Policy Optimization in Matrix Form. CoRR Sitao Luan, Xiao-Wen Chang, Doina Precup
2019	J	`jnl`	SVRG for Policy Evaluation with Fewer Gradient Evaluations. CoRR Zilun Peng, Ahmed Touati, Pascal Vincent, Doina Precup
2019	J	`jnl`	Self-supervised Learning of Distance Functions for Goal-Conditioned Reinforcement Learning. CoRR Srinivas Venkattaramanujam, Eric Crawford, Thang Doan, Doina Precup
2019	J	`jnl`	Shaping representations through communication: community size effect in artificial learning systems. CoRR Olivier Tieleman, Angeliki Lazaridou, Shibl Mourad, Charles Blundell, Doina Precup
2019	J	`jnl`	Singular value automata and approximate minimization. Math. Struct. Comput. Sci. Borja Balle, Prakash Panangaden, Doina Precup
2019	—	`conf`	Temporally Extended Metrics for Markov Decision Processes. SafeAI@AAAI Philip Amortila, Marc G. Bellemare, Prakash Panangaden, Doina Precup
2019	A*	`conf`	The Option Keyboard: Combining Skills in Reinforcement Learning. NeurIPS André Barreto, Diana Borsa, Shaobo Hou, Gheorghe Comanici, Eser Aygün, Philippe Hamel, Daniel Toyama, Jonathan J. Hunt, Shibl Mourad, David Silver, Doina Precup
2019	A	`conf`	The Termination Critic. AISTATS Anna Harutyunyan, Will Dabney, Diana Borsa, Nicolas Heess, Rémi Munos, Doina Precup
2019	J	`jnl`	The Termination Critic. CoRR Anna Harutyunyan, Will Dabney, Diana Borsa, Nicolas Heess, Rémi Munos, Doina Precup
2019	A*	`conf`	Uncertainty Aware Learning from Demonstrations in Multiple Contexts using Bayesian Neural Networks. ICRA Sanjay Thakur, Herke van Hoof, Juan Camilo Gamboa Higuera, Doina Precup, David Meger
2019	J	`jnl`	Uncertainty Aware Learning from Demonstrations in Multiple Contexts using Bayesian Neural Networks. CoRR Sanjay Thakur, Herke van Hoof, Juan Camilo Gamboa Higuera, Doina Precup, David Meger
2018	J	`jnl`	Attend Before you Act: Leveraging human visual attention for continual learning. CoRR Khimya Khetarpal, Doina Precup
2018	J	`jnl`	Clustering-Oriented Representation Learning with Attractive-Repulsive Loss. CoRR Kian Kenyon-Dean, Andre Cianflone, Lucas Page-Caccia, Guillaume Rabusseau, Jackie Chi Kit Cheung, Doina Precup
2018	J	`jnl`	Combined Reinforcement Learning via Abstract Representations. CoRR Vincent François-Lavet, Yoshua Bengio, Doina Precup, Joelle Pineau
2018	J	`jnl`	Connecting Weighted Automata and Recurrent Neural Networks through Spectral Learning. CoRR Guillaume Rabusseau, Tianyu Li, Doina Precup
2018	J	`jnl`	Constructing Temporal Abstractions Autonomously in Reinforcement Learning. AI Mag. Pierre-Luc Bacon, Doina Precup
2018	A*	`conf`	Convergent TREE BACKUP and RETRACE with Function Approximation. ICML Ahmed Touati, Pierre-Luc Bacon, Doina Precup, Pascal Vincent
2018	A*	`conf`	Deep Reinforcement Learning That Matters. AAAI Peter Henderson, Riashat Islam, Philip Bachman, Joelle Pineau, Doina Precup, David Meger
2018	J	`jnl`	Disentangling the independently controllable factors of variation by interacting with the world. CoRR Valentin Thomas, Emmanuel Bengio, William Fedus, Jules Pondard, Philippe Beaudoin, Hugo Larochelle, Joelle Pineau, Doina Precup, Yoshua Bengio
2018	J	`jnl`	Dyna Planning using a Feature Based Generative Model. CoRR Ryan Faulkner, Doina Precup
2018	A	`conf`	Eligibility Traces for Options. AAMAS Ayush Jain, Doina Precup
2018	J	`jnl`	Environments for Lifelong Reinforcement Learning. CoRR Khimya Khetarpal, Shagun Sodhani, Sarath Chandar, Doina Precup
2018	—	`conf`	Exploring Uncertainty Measures in Deep Networks for Multiple Sclerosis Lesion Detection and Segmentation. MICCAI (1) Tanya Nair, Doina Precup, Douglas L. Arnold, Tal Arbel
2018	J	`jnl`	Exploring Uncertainty Measures in Deep Networks for Multiple Sclerosis Lesion Detection and Segmentation. CoRR Tanya Nair, Doina Precup, Douglas L. Arnold, Tal Arbel
2018	A*	`conf`	Imitation Upper Confidence Bound for Bandits on a Graph. AAAI Andrei Lupu, Doina Precup
2018	A*	`conf`	Learning Predictive State Representations From Non-Uniform Sampling. AAAI Yuri Grinberg, Hossein Aboutalebi, Melanie Lyman-Abramovitch, Borja Balle, Doina Precup
2018	A*	`conf`	Learning Robust Options. AAAI Daniel J. Mankowitz, Timothy A. Mann, Pierre-Luc Bacon, Doina Precup, Shie Mannor
2018	J	`jnl`	Learning Robust Options. CoRR Daniel J. Mankowitz, Timothy A. Mann, Pierre-Luc Bacon, Doina Precup, Shie Mannor
2018	A*	`conf`	Learning Safe Policies with Expert Guidance. NeurIPS Jessie Huang, Fa Wu, Doina Precup, Yang Cai
2018	J	`jnl`	Learning Safe Policies with Expert Guidance. CoRR Jessie Huang, Fa Wu, Doina Precup, Yang Cai
2018	A*	`conf`	Learning With Options That Terminate Off-Policy. AAAI Anna Harutyunyan, Peter Vrancx, Pierre-Luc Bacon, Doina Precup, Ann Nowé
2018	A	`conf`	Leveraging Observational Learning for Exploration in Bandits. AAMAS Andrei Lupu, Audrey Durand, Doina Precup
2018	A	`conf`	Nonlinear Weighted Finite Automata. AISTATS Tianyu Li, Guillaume Rabusseau, Doina Precup
2018	J	`jnl`	Off-Policy Deep Reinforcement Learning without Exploration. CoRR Scott Fujimoto, David Meger, Doina Precup
2018	A*	`conf`	OptionGAN: Learning Joint Reward-Policy Options Using Generative Adversarial Inverse Reinforcement Learning. AAAI Peter Henderson, Wei-Di Chang, Pierre-Luc Bacon, David Meger, Joelle Pineau, Doina Precup
2018	J	`jnl`	Predicting Extubation Readiness in Extreme Preterm Infants based on Patterns of Breathing. CoRR Charles C. Onu, Lara J. Kanbar, Wissam Shalish, Karen A. Brown, Guilherme M. Sant'Anna, Robert E. Kearney, Doina Precup
2018	—	`conf`	Resolving Event Coreference with Supervised Representation Learning and Clustering-Oriented Regularization. *SEM@NAACL-HLT Kian Kenyon-Dean, Jackie Chi Kit Cheung, Doina Precup
2018	J	`jnl`	Resolving Event Coreference with Supervised Representation Learning and Clustering-Oriented Regularization. CoRR Kian Kenyon-Dean, Jackie Chi Kit Cheung, Doina Precup
2018	J	`jnl`	Safe Option-Critic: Learning Safety in the Option-Critic Architecture. CoRR Arushi Jain, Khimya Khetarpal, Doina Precup
2018	A*	`conf`	Temporal Regularization for Markov Decision Process. NeurIPS Pierre Thodoroff, Audrey Durand, Joelle Pineau, Doina Precup
2018	J	`jnl`	Temporal Regularization in Markov Decision Process. CoRR Pierre Thodoroff, Audrey Durand, Joelle Pineau, Doina Precup
2018	J	`jnl`	The Barbados 2018 List of Open Issues in Continual Learning. CoRR Tom Schaul, Hado van Hasselt, Joseph Modayil, Martha White, Adam White, Pierre-Luc Bacon, Jean Harb, Shibl Mourad, Marc G. Bellemare, Doina Precup
2018	—	`conf`	Undersampling and Bagging of Decision Trees in the Analysis of Cardiorespiratory Behavior for the Prediction of Extubation Readiness in Extremely Preterm Infants. EMBC Lara J. Kanbar, Charles C. Onu, Wissam Shalish, Karen A. Brown, Guilherme M. Sant'Anna, Doina Precup, Robert E. Kearney
2018	J	`jnl`	Undersampling and Bagging of Decision Trees in the Analysis of Cardiorespiratory Behavior for the Prediction of Extubation Readiness in Extremely Preterm Infants. CoRR Lara J. Kanbar, Charles C. Onu, Wissam Shalish, Karen A. Brown, Guilherme M. Sant'Anna, Robert E. Kearney, Doina Precup
2018	A*	`conf`	When Waiting Is Not an Option: Learning Options With a Deliberation Cost. AAAI Jean Harb, Pierre-Luc Bacon, Martin Klissarov, Doina Precup
2017	—	`conf`	A semi-Markov chain approach to modeling respiratory patterns prior to extubation in preterm infants. EMBC Charles C. Onu, Lara J. Kanbar, Wissam Shalish, Karen A. Brown, Guilherme M. Sant'Anna, Robert E. Kearney, Doina Precup
2017	—	`conf`	APEX_SCOPE: A graphical user interface for visualization of multi-modal data in inter-disciplinary studies. EMBC Lara J. Kanbar, Wissam Shalish, Doina Precup, Karen A. Brown, Guilherme M. Sant'Anna, Robert E. Kearney
2017	A*	`conf`	Approximate Value Iteration with Temporally Extended Actions (Extended Abstract). IJCAI Timothy A. Mann, Shie Mannor, Doina Precup
2017	—	`conf`	Boosting Based Multiple Kernel Learning and Transfer Regression for Electricity Load Forecasting. ECML/PKDD (3) Di Wu, Boyu Wang, Doina Precup, Benoit Boulet
2017	J	`jnl`	Convergent Tree-Backup and Retrace with Function Approximation. CoRR Ahmed Touati, Pierre-Luc Bacon, Doina Precup, Pascal Vincent
2017	J	`jnl`	Deep Reinforcement Learning that Matters. CoRR Peter Henderson, Riashat Islam, Philip Bachman, Joelle Pineau, Doina Precup, David Meger
2017	—	`conf`	Horizontal and Vertical Self-Adaptive Cloud Controller with Reward Optimization for Resource Allocation. ICCAC Jesús Alejandro Cárdenes Cabré, Doina Precup, Ricardo Sanz
2017	J	`jnl`	Independently Controllable Factors. CoRR Valentin Thomas, Jules Pondard, Emmanuel Bengio, Marc Sarfati, Philippe Beaudoin, Marie-Jean Meurs, Joelle Pineau, Doina Precup, Yoshua Bengio
2017	J	`jnl`	Independently Controllable Features. CoRR Emmanuel Bengio, Valentin Thomas, Joelle Pineau, Doina Precup, Yoshua Bengio
2017	J	`jnl`	Investigating Recurrence and Eligibility Traces in Deep Q-Networks. CoRR Jean Harb, Doina Precup
2017	J	`jnl`	Learning with Options that Terminate Off-Policy. CoRR Anna Harutyunyan, Peter Vrancx, Pierre-Luc Bacon, Doina Precup, Ann Nowé
2017	B	`conf`	Learning-based interactive segmentation using the maximum mean cycle weight formalism. Image Processing Sharmin Nilufar, Dao Sen Wang, John Girgis, Carmen G. Palii, D. Yang, A. Blais, M. Brand, Doina Precup, Theodore J. Perkins
2017	J	`jnl`	Learnings Options End-to-End for Continuous Action Tasks. CoRR Martin Klissarov, Pierre-Luc Bacon, Jean Harb, Doina Precup
2017	J	`jnl`	Multi-Timescale, Gradient Descent, Temporal Difference Learning with Linear Options. CoRR Peeyush Kumar, Doina Precup
2017	J	`jnl`	Neural Network Based Nonlinear Weighted Finite Automata. CoRR Tianyu Li, Guillaume Rabusseau, Doina Precup
2017	J	`jnl`	OptionGAN: Learning Joint Reward-Policy Options using Generative Adversarial Inverse Reinforcement Learning. CoRR Peter Henderson, Wei-Di Chang, Pierre-Luc Bacon, David Meger, Joelle Pineau, Doina Precup
2017	—	`conf`	Predicting Future Disease Activity and Treatment Responders for Multiple Sclerosis Patients Using a Bag-of-Lesions Brain Representation. MICCAI (3) Andrew Doyle, Doina Precup, Douglas L. Arnold, Tal Arbel
2017	—	`conf`	Predicting extubation readiness in extreme preterm infants based on patterns of breathing. SSCI Charles C. Onu, Lara J. Kanbar, Wissam Shalish, Karen A. Brown, Guilherme M. Sant'Anna, Robert E. Kearney, Doina Precup
2017	A*	`ed.`	Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6-11 August 2017 ICML Doina Precup, Yee Whye Teh
2017	A*	`conf`	Real-Time Indoor Localization in Smart Homes Using Semi-Supervised Learning. AAAI Negar Ghourchian, Michel Allegue-Martínez, Doina Precup
2017	J	`jnl`	Reproducibility of Benchmarked Deep Reinforcement Learning Tasks for Continuous Control. CoRR Riashat Islam, Peter Henderson, Maziar Gomrokchi, Doina Precup
2017	J	`jnl`	Singular value automata and approximate minimization. CoRR Borja Balle, Prakash Panangaden, Doina Precup
2017	A*	`conf`	The Option-Critic Architecture. AAAI Pierre-Luc Bacon, Jean Harb, Doina Precup
2017	J	`jnl`	Ubenwa: Cry-based Diagnosis of Birth Asphyxia. CoRR Charles C. Onu, Innocent Udeogu, Eyenimi Ndiomu, Urbain Kengni, Doina Precup, Guilherme M. Sant'Anna, Edward Alikor, Peace Opara
2017	J	`jnl`	Variational Generative Stochastic Networks with Collaborative Shaping. CoRR Philip Bachman, Doina Precup
2017	J	`jnl`	When Waiting is not an Option : Learning Options with a Deliberation Cost. CoRR Jean Harb, Pierre-Luc Bacon, Martin Klissarov, Doina Precup
2017	A*	`conf`	World Knowledge for Reading Comprehension: Rare Entity Prediction with Hierarchical LSTMs Using External Descriptions. EMNLP Teng Long, Emmanuel Bengio, Ryan Lowe, Jackie Chi Kit Cheung, Doina Precup
2016	J	`jnl`	A Matrix Splitting Perspective on Planning with Options. CoRR Pierre-Luc Bacon, Doina Precup
2016	—	`conf`	Automated ongoing data validation and quality control of multi-institutional studies. EMBC Lara J. Kanbar, Wissam Shalish, Doina Precup, Karen A. Brown, Guilherme M. Sant'Anna, Robert E. Kearney
2016	A*	`conf`	Differentially Private Policy Evaluation. ICML Borja Balle, Maziar Gomrokchi, Doina Precup
2016	J	`jnl`	Differentially Private Policy Evaluation. CoRR Borja Balle, Maziar Gomrokchi, Doina Precup
2016	J	`jnl`	Editorial on Special Issue on Probabilistic Models for Biomedical Image Analysis. Comput. Vis. Image Underst. Tal Arbel, Manuel Jorge Cardoso, William M. Wells III, Albert C. S. Chung, Doina Precup
2016	J	`jnl`	Hierarchical Spatio-Temporal Probabilistic Graphical Model with Multiple Feature Fusion for Binary Facial Attribute Classification in Real-World Face Videos. IEEE Trans. Pattern Anal. Mach. Intell. Meltem Demirkus, Doina Precup, James J. Clark, Tal Arbel
2016	A*	`conf`	Incremental Stochastic Factorization for Online Reinforcement Learning. AAAI André da Motta Salles Barreto, Rafael L. Beirigo, Joelle Pineau, Doina Precup
2016	A*	`conf`	Learning Multi-Step Predictive State Representations. IJCAI Lucas Langer, Borja Balle, Doina Precup
2016	—	`conf`	Leveraging Lexical Resources for Learning Entity Embeddings in Multi-Relational Data. ACL (2) Teng Long, Ryan Lowe, Jackie Chi Kit Cheung, Doina Precup
2016	J	`jnl`	Leveraging Lexical Resources for Learning Entity Embeddings in Multi-Relational Data. CoRR Teng Long, Ryan Lowe, Jackie Chi Kit Cheung, Doina Precup
2016	J	`jnl`	Practical Kernel-Based Reinforcement Learning. J. Mach. Learn. Res. André da Motta Salles Barreto, Doina Precup, Joelle Pineau
2016	—	`conf`	Prediction of Cell Type Specific Transcription Factor Binding Site Occupancy. BCB Faizy Ahsan, Doina Precup, Mathieu Blanchette
2016	J	`jnl`	The Option-Critic Architecture. CoRR Pierre-Luc Bacon, Jean Harb, Doina Precup
2016	A*	`conf`	Verb Phrase Ellipsis Resolution Using Discriminative and Margin-Infused Algorithms. EMNLP Kian Kenyon-Dean, Jackie Chi Kit Cheung, Doina Precup
2015	A*	`conf`	A Canonical Form for Weighted Automata and Applications to Approximate Minimization. LICS Borja Balle, Prakash Panangaden, Doina Precup
2015	J	`jnl`	A Canonical Form for Weighted Automata and Applications to Approximate Minimization. CoRR Borja Balle, Prakash Panangaden, Doina Precup
2015	A*	`conf`	An Expectation-Maximization Algorithm to Compute a Stochastic Factorization From Data. IJCAI André da Motta Salles Barreto, Rafael L. Beirigo, Joelle Pineau, Doina Precup
2015	J	`jnl`	Approximate Value Iteration with Temporally Extended Actions. J. Artif. Intell. Res. Timothy A. Mann, Shie Mannor, Doina Precup
2015	—	`conf`	Basis refinement strategies for linear value function approximation in MDPs. NIPS Gheorghe Comanici, Doina Precup, Prakash Panangaden
2015	J	`jnl`	Classification-Based Approximate Policy Iteration. IEEE Trans. Autom. Control. Amir-massoud Farahmand, Doina Precup, André da Motta Salles Barreto, Mohammad Ghavamzadeh
2015	J	`jnl`	Conditional Computation in Neural Networks for faster models. CoRR Emmanuel Bengio, Pierre-Luc Bacon, Joelle Pineau, Doina Precup
2015	—	`conf`	Correlation of clinical parameters with cardiorespiratory behavior in successfully extubated extremely preterm infants. EMBC Lara J. Kanbar, Wissam Shalish, Carlos A. Robles-Rubio, Doina Precup, Karen A. Brown, Guilherme M. Sant'Anna, Robert E. Kearney
2015	—	`conf`	Data Generation as Sequential Decision Making. NIPS Philip Bachman, Doina Precup
2015	J	`jnl`	Data Generation as Sequential Decision Making. CoRR Philip Bachman, Doina Precup
2015	—	`conf`	Feature selection and oversampling in analysis of clinical data for extubation readiness in extreme preterm infants. EMBC Pascale Gourdeau, Lara J. Kanbar, Wissam Shalish, Guilherme M. Sant'Anna, Robert E. Kearney, Doina Precup
2015	J	`jnl`	Hierarchical temporal graphical model for head pose estimation and subsequent attribute classification in real-world videos. Comput. Vis. Image Underst. Meltem Demirkus, Doina Precup, James J. Clark, Tal Arbel
2015	—	`conf`	IMaGe: Iterative Multilevel Probabilistic Graphical Model for Detection and Segmentation of Multiple Sclerosis Lesions in Brain MRI. IPMI Nagesh K. Subbanna, Doina Precup, Douglas L. Arnold, Tal Arbel
2015	A	`conf`	Learning and Planning with Timing Information in Markov Decision Processes. UAI Pierre-Luc Bacon, Borja Balle, Doina Precup
2015	—	`conf`	Organizational principles of cloud storage to support collaborative biomedical research. EMBC Lara J. Kanbar, Wissam Shalish, Carlos A. Robles-Rubio, Doina Precup, Karen A. Brown, Guilherme M. Sant'Anna, Robert E. Kearney
2015	J	`jnl`	Policy Gradient Methods for Off-policy Control. CoRR Lucas Lehnert, Doina Precup
2015	J	`jnl`	Quantifying the determinants of outbreak detection performance through simulation and machine learning. J. Biomed. Informatics Nastaran Jafarpour, Masoumeh T. Izadi, Doina Precup, David L. Buckeridge
2015	A*	`conf`	Representation Discovery for MDPs Using Bisimulation Metrics. AAAI Sherry Shanshan Ruan, Gheorghe Comanici, Prakash Panangaden, Doina Precup
2015	A*	`conf`	Representation Discovery for MDPs Using Bisimulation Metrics. AAAI Sherry Shanshan Ruan, Gheorghe Comanici, Prakash Panangaden, Doina Precup
2015	J	`jnl`	Testing Visual Attention in Dynamic Environments. CoRR Philip Bachman, David Krueger, Doina Precup
2015	J	`jnl`	The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS). IEEE Trans. Medical Imaging Bjoern H. Menze, András Jakab, Stefan Bauer, Jayashree Kalpathy-Cramer, Keyvan Farahani, Justin S. Kirby, Yuliya Burren, Nicole Porz, Johannes Slotboom, Roland Wiest, Levente Lanczi, Elizabeth R. Gerstner, Marc-André Weber, Tal Arbel, Brian B. Avants, Nicholas Ayache, Patricia Buendia, D. Louis Collins, Nicolas Cordier, Jason J. Corso, Antonio Criminisi, Tilak Das, Herve Delingette, Çagatay Demiralp, Christopher R. Durst, Michel Dojat, Senan Doyle, Joana Festa, Florence Forbes, Ezequiel Geremia, Ben Glocker, Polina Golland, Xiaotao Guo, Andac Hamamci, Khan M. Iftekharuddin, Raj Jena, Nigel M. John, Ender Konukoglu, Danial Lashkari, José Antonio Mariz, Raphael Meier, Sérgio Pereira, Doina Precup, Stephen J. Price, Tammy Riklin Raviv, Syed M. S. Reza, Michael T. Ryan, Duygu Sarikaya, Lawrence H. Schwartz, Hoo-Chang Shin, Jamie Shotton, Carlos A. Silva, Nuno J. Sousa, Nagesh K. Subbanna, Gábor Székely, Thomas J. Taylor, Owen M. Thomas, Nicholas J. Tustison, Gözde B. Ünal, Flor Vasseur, Max Wintermark, Dong Hye Ye, Liang Zhao, Binsheng Zhao, Darko Zikic, Marcel Prastawa, Mauricio Reyes, Koen Van Leemput
2015	A*	`conf`	Variational Generative Stochastic Networks with Collaborative Shaping. ICML Philip Bachman, Doina Precup
2014	A*	`conf`	A new Q(lambda) with interim forward view and Monte Carlo equivalence. ICML Richard S. Sutton, Ashique Rupam Mahmood, Doina Precup, Hado van Hasselt
2014	J	`jnl`	Algorithms for multi-armed bandit problems. CoRR Volodymyr Kuleshov, Doina Precup
2014	—	`conf`	Analyzing User Trajectories from Mobile Device Data with Hierarchical Dirichlet Processes. Canadian AI Negar Ghourchian, Doina Precup
2014	—	`ed.`	Bayesian and grAphical Models for Biomedical Imaging - First International Workshop, BAMBI 2014, Cambridge, MA, USA, September 18, 2014, Revised Selected Papers BAMBI Manuel Jorge Cardoso, Ivor J. A. Simpson, Tal Arbel, Doina Precup, Annemie Ribbens
2014	A	`conf`	Bisimulation Metrics are Optimal Value Functions. UAI Norman Ferns, Doina Precup
2014	—	`conf`	Bisimulation for Markov Decision Processes through Families of Functional Expressions. Horizons of the Mind Norm Ferns, Doina Precup, Sophia Knight
2014	J	`jnl`	Classification-based Approximate Policy Iteration: Experiments and Extended Discussions. CoRR Amir-massoud Farahmand, Doina Precup, André da Motta Salles Barreto, Mohammad Ghavamzadeh
2014	A*	`conf`	Iterative Multilevel MRF Leveraging Context and Voxel Information for Brain Tumour Segmentation in MRI. CVPR Nagesh K. Subbanna, Doina Precup, Tal Arbel
2014	—	`conf`	Learning with Pseudo-Ensembles. NIPS Philip Bachman, Ouais Alsharif, Doina Precup
2014	J	`jnl`	Learning with Pseudo-Ensembles. CoRR Philip Bachman, Ouais Alsharif, Doina Precup
2014	B	`conf`	Multi-layer temporal graphical model for head pose estimation in real-world videos. ICIP Meltem Demirkus, Doina Precup, James J. Clark, Tal Arbel
2014	—	`conf`	Optimizing Energy Production Using Policy Search and Predictive State Representations. NIPS Yuri Grinberg, Doina Precup, Michel Gendreau
2014	J	`jnl`	Policy Iteration Based on Stochastic Factorization. J. Artif. Intell. Res. André da Motta Salles Barreto, Joelle Pineau, Doina Precup
2014	J	`jnl`	Practical Kernel-Based Reinforcement Learning. CoRR André da Motta Salles Barreto, Doina Precup, Joelle Pineau
2014	—	`conf`	Probabilistic Temporal Head Pose Estimation Using a Hierarchical Graphical Model. ECCV (1) Meltem Demirkus, Doina Precup, James J. Clark, Tal Arbel
2014	A*	`conf`	Sample-based approximate regularization. ICML Philip Bachman, Amir-massoud Farahmand, Doina Precup
2014	J	`jnl`	Theoretical results on the effect of 'shortcut' actions in MDPs. Connect. Sci. Sara M. McCarthy, Doina Precup
2013	C	`conf`	Assessing the Predictability of Hospital Readmission Using Machine Learning. IAAI Arian Hosseinzadeh, Masoumeh T. Izadi, Aman Verma, Doina Precup, David L. Buckeridge
2013	—	`conf`	Average Reward Optimization Objective In Partially Observable Domains. ICML (1) Yuri Grinberg, Doina Precup
2013	—	`conf`	Bellman Error Based Feature Generation using Random Projections on Sparse Spaces. NIPS Mahdi Milani Fard, Yuri Grinberg, Amir-massoud Farahmand, Joelle Pineau, Doina Precup
2013	J	`jnl`	Generating storylines from sensor data. Pervasive Mob. Comput. Jordan Frank, Shie Mannor, Doina Precup
2013	—	`conf`	Greedy Confidence Pursuit: A Pragmatic Approach to Multi-bandit Optimization. ECML/PKDD (1) Philip Bachman, Doina Precup
2013	—	`conf`	Hierarchical Probabilistic Gabor and MRF Segmentation of Brain Tumours in MRI Volumes. MICCAI (1) Nagesh K. Subbanna, Doina Precup, D. Louis Collins, Tal Arbel
2013	—	`conf`	Learning from Limited Demonstrations. NIPS Beomjoon Kim, Amir-massoud Farahmand, Joelle Pineau, Doina Precup
2013	C	`conf`	Smart Classifier Selection for Activity Recognition on Wearable Devices. ICPRAM Negar Ghourchian, Doina Precup
2013	A	`conf`	Smart exploration in reinforcement learning using absolute temporal difference errors. AAMAS Clement Gehring, Doina Precup
2013	J	`jnl`	Time Series Analysis Using Geometric Template Matching. IEEE Trans. Pattern Anal. Mach. Intell. Jordan Frank, Shie Mannor, Joelle Pineau, Doina Precup
2013	Misc	`conf`	Using Hierarchical Mixture of Experts Model for Fusion of Outbreak Detection Methods. AMIA Nastaran Jafarpour, Doina Precup, Masoumeh T. Izadi, David L. Buckeridge
2012	J	`jnl`	A Machine Learning Approach to the Detection of Fetal Hypoxia during Labor and Delivery. AI Mag. Philip A. Warrick, Emily F. Hamilton, Robert E. Kearney, Doina Precup
2012	—	`conf`	An Empirical Analysis of Off-policy Learning in Discrete MDPs. EWRL Cosmin Paduraru, Doina Precup, Joelle Pineau, Gheorghe Comanici
2012	J	`jnl`	An information-theoretic approach to curiosity-driven reinforcement learning. Theory Biosci. Susanne Still, Doina Precup
2012	J	`jnl`	Bellman Error Based Feature Generation using Random Projections on Sparse Spaces CoRR Mahdi Milani Fard, Yuri Grinberg, Amir Massoud Farahmand, Joelle Pineau, Doina Precup
2012	A*	`conf`	Compressed Least-Squares Regression on Sparse Spaces. AAAI Mahdi Milani Fard, Yuri Grinberg, Joelle Pineau, Doina Precup
2012	A*	`conf`	Improved Estimation in Time Varying Models. ICML Doina Precup, Philip Bachman
2012	J	`jnl`	Methods for computing state similarity in Markov Decision Processes. CoRR Norman Ferns, Pablo Samuel Castro, Doina Precup, Prakash Panangaden
2012	J	`jnl`	Metrics for Finite Markov Decision Processes CoRR Norman Ferns, Prakash Panangaden, Doina Precup
2012	J	`jnl`	Metrics for Markov Decision Processes with Infinite State Spaces CoRR Norman Ferns, Prakash Panangaden, Doina Precup
2012	—	`conf`	Mining Administrative Data to Predict Falls in the Elderly Population. Canadian AI Arian Hosseinzadeh, Masoumeh T. Izadi, Doina Precup, David L. Buckeridge
2012	A	`conf`	On Average Reward Policy Evaluation in Infinite-State Partially Observable Systems. AISTATS Yuri Grinberg, Doina Precup
2012	—	`conf`	On-line Reinforcement Learning Using Incremental Kernel-Based Stochastic Factorization. NIPS André da Motta Salles Barreto, Doina Precup, Joelle Pineau
2012	—	`conf`	On-the-Fly Algorithms for Bisimulation Metrics. QEST Gheorghe Comanici, Prakash Panangaden, Doina Precup
2012	—	`conf`	Prediction of extubation readiness in extreme preterm infants based on measures of cardiorespiratory variability. EMBC Doina Precup, Carlos A. Robles-Rubio, Karen A. Brown, Lara J. Kanbar, Jennifer Kaczmarek, Sanjay Chawla, Guilherme M. Sant'Anna, Robert E. Kearney
2012	J	`jnl`	Reports of the AAAI 2011 Conference Workshops. AI Mag. Noa Agmon, Vikas Agrawal, David W. Aha, Yiannis Aloimonos, Donagh Buckley, Prashant Doshi, Christopher W. Geib, Floriana Grasso, Nancy L. Green, Benjamin Johnston, Burt Kaliski, Christopher Kiekintveld, Edith Law, Henry Lieberman, Ole J. Mengshoel, Ted Metzler, Joseph Modayil, Douglas W. Oard, Nilufer Onder, Barry O'Sullivan, Katerina Pastra, Doina Precup, Sowmya Ramachandran, Chris Reed, Sanem Sariel Talay, Ted Selker, Lokendra Shastri, Stephen F. Smith, Satinder Singh, Siddharth Srivastava, Gita Sukthankar, David C. Uthus, Mary-Anne Williams
2012	—	`conf`	Soft biometric trait classification from real-world face videos conditioned on head pose estimation. CVPR Workshops Meltem Demirkus, Doina Precup, James J. Clark, Tal Arbel
2012	—	`conf`	Value Pursuit Iteration. NIPS Amir Massoud Farahmand, Doina Precup
2011	—	`conf`	A Framework for Computing Bounds for the Return of a Policy. EWRL Cosmin Paduraru, Doina Precup, Joelle Pineau
2011	—	`conf`	Activity Recognition with Mobile Phones. ECML/PKDD (3) Jordan Frank, Shie Mannor, Doina Precup
2011	—	`conf`	Activity Recognition with Time-Delay Emobeddings. AAAI Spring Symposium: Computational Physiology Jordan Frank, Shie Mannor, Doina Precup
2011	—	`conf`	Adapted MRF Segmentation of Multiple Sclerosis Lesions Using Local Contextual Information. MIUA Nagesh K. Subbanna, Simon J. Francis, Doina Precup, D. Louis Collins, Douglas L. Arnold, Tal Arbel
2011	—	`conf`	Automatic Construction of Temporally Extended Actions for MDPs Using Bisimulation Metrics. EWRL Pablo Samuel Castro, Doina Precup
2011	A*	`conf`	Basis Function Discovery Using Spectral Clustering and Bisimulation Metrics. AAAI Gheorghe Comanici, Doina Precup
2011	—	`conf`	Basis Function Discovery Using Spectral Clustering and Bisimulation Metrics. ALA Gheorghe Comanici, Doina Precup
2011	A	`conf`	Basis function discovery using spectral clustering and bisimulation metrics. AAMAS Gheorghe Comanici, Doina Precup
2011	J	`jnl`	Bisimulation Metrics for Continuous Markov Decision Processes. SIAM J. Comput. Norm Ferns, Prakash Panangaden, Doina Precup
2011	A	`conf`	Horde: a scalable real-time architecture for learning knowledge from unsupervised sensorimotor interaction. AAMAS Richard S. Sutton, Joseph Modayil, Michael Delp, Thomas Degris, Patrick M. Pilarski, Adam White, Doina Precup
2011	A*	`conf`	Learning Compact Representations of Time-Varying Processes. AAAI Philip Bachman, Doina Precup
2011	—	`conf`	Reinforcement Learning using Kernel-Based Stochastic Factorization. NIPS André da Motta Salles Barreto, Doina Precup, Joelle Pineau
2011	—	`conf`	The Duality of State and Observation in Probabilistic Transition Systems. TbiLLC Monica Dinculescu, Christopher Hundt, Prakash Panangaden, Joelle Pineau, Doina Precup
2010	C	`conf`	A Machine Learning Approach to the Detection of Fetal Hypoxia during Labor and Delivery. IAAI Philip A. Warrick, Emily F. Hamilton, Robert E. Kearney, Doina Precup
2010	C	`conf`	A Study of Approximate Inference in Probabilistic Relational Models. ACML Fabian Kaelin, Doina Precup
2010	—	`conf`	A novel similarity measure for time series data with applications to gait and activity recognition. UbiComp (Adjunct Papers) Jordan Frank, Shie Mannor, Doina Precup
2010	A*	`conf`	Activity and Gait Recognition with Time-Delay Embeddings. AAAI Jordan Frank, Shie Mannor, Doina Precup
2010	—	`conf`	An Algebraic Approach to Dynamic Epistemic Logic. Description Logics Prakash Panangaden, Caitlin Phillips, Doina Precup, Mehrnoosh Sadrzadeh
2010	A*	`conf`	Approximate Predictive Representations of Partially Observable Systems. ICML Monica Dinculescu, Doina Precup
2010	A	`conf`	Automatically suggesting topics for augmenting text documents. CIKM Robert West, Doina Precup, Joelle Pineau
2010	J	`jnl`	Classification of Normal and Hypoxic Fetuses From Systems Modeling of Intrapartum Cardiotocography. IEEE Trans. Biomed. Eng. Philip A. Warrick, Emily F. Hamilton, Doina Precup, Robert E. Kearney
2010	A	`conf`	Optimal policy switching algorithms for reinforcement learning. AAMAS Gheorghe Comanici, Doina Precup
2010	—	`conf`	Smarter Sampling in Model-Based Bayesian Reinforcement Learning. ECML/PKDD (1) Pablo Samuel Castro, Doina Precup
2010	A*	`conf`	Using Bisimulation for Policy Transfer in MDPs. AAAI Pablo Samuel Castro, Doina Precup
2010	A	`conf`	Using bisimulation for policy transfer in MDPs. AAMAS Pablo Samuel Castro, Doina Precup
2009	A	`conf`	Completing wikipedia's hyperlink structure through dimensionality reduction. CIKM Robert West, Doina Precup, Joelle Pineau
2009	—	`conf`	Convergent Temporal-Difference Learning with Arbitrary Smooth Function Approximation. NIPS Hamid Reza Maei, Csaba Szepesvári, Shalabh Bhatnagar, Doina Precup, David Silver, Richard S. Sutton
2009	A*	`conf`	Equivalence Relations in Fully and Partially Observable Markov Decision Processes. IJCAI Pablo Samuel Castro, Prakash Panangaden, Doina Precup
2009	A*	`conf`	Fast gradient-descent methods for temporal-difference learning with linear function approximation. ICML Richard S. Sutton, Hamid Reza Maei, Doina Precup, Shalabh Bhatnagar, David Silver, Csaba Szepesvári, Eric Wiewiora
2009	J	`jnl`	Identification of the Dynamic Relationship Between Intrapartum Uterine Pressure and Fetal Heart Rate for Normal and Hypoxic Fetuses. IEEE Trans. Biomed. Eng. Philip A. Warrick, Emily F. Hamilton, Doina Precup, Robert E. Kearney
2009	—	`conf`	Learning the Difference between Partially Observable Dynamical Systems. ECML/PKDD (2) Sami Zhioua, Doina Precup, François Laviolette, Josée Desharnais
2009	A*	`conf`	Wikispeedia: An Online Game for Inferring Semantic Distances between Concepts. IJCAI Robert West, Joelle Pineau, Doina Precup
2008	J	`jnl`	Anytime similarity measures for faster alignment. Comput. Vis. Image Underst. Rupert Brooks, Tal Arbel, Doina Precup
2008	—	`conf`	Bounding Performance Loss in Approximate MDP Homomorphisms. NIPS Jonathan Taylor, Doina Precup, Prakash Panangaden
2008	—	`conf`	Point-Based Planning for Predictive State Representations. Canadian AI Masoumeh T. Izadi, Doina Precup
2008	A*	`conf`	Reinforcement learning in the presence of rare events. ICML Jordan Frank, Shie Mannor, Doina Precup
2007	A*	`conf`	A formal framework for robot learning and control under model uncertainty. ICRA Robin Jaulmes, Joelle Pineau, Doina Precup
2007	J	`jnl`	Apprentissage actif dans les processus décisionnels de Markov partiellement observables L'algorithme MEDUSA. Rev. d'Intelligence Artif. Robin Jaulmes, Joelle Pineau, Doina Precup
2007	A*	`conf`	Context-Driven Predictions. IJCAI Marc G. Bellemare, Doina Precup
2007	A*	`conf`	Fast Image Alignment Using Anytime Algorithms. IJCAI Rupert Brooks, Tal Arbel, Doina Precup
2007	—	`conf`	Representing Systems with Hidden State. AAAI Fall Symposium: Computational Approaches to Representation Change during Learning and Development Christopher Hundt, Prakash Panangaden, Joelle Pineau, Doina Precup
2007	A*	`conf`	Using Linear Programming for Bayesian Exploration in Markov Decision Processes. IJCAI Pablo Samuel Castro, Doina Precup
2006	A*	`conf`	Automatic basis function construction for approximate dynamic programming and reinforcement learning. ICML Philipp W. Keller, Shie Mannor, Doina Precup
2006	—	`conf`	Belief Selection in Point-Based Planning Algorithms for POMDPs. Canadian AI Masoumeh T. Izadi, Doina Precup, Danielle Azar
2006	B	`conf`	Data Mining Using Relational Database Management Systems. PAKDD Beibei Zou, Xuesong Ma, Bettina Kemme, Glen Newton, Doina Precup
2006	—	`conf`	Linear models of intrapartum uterine pressure-fetal heart rate interaction for the normal and hypoxic fetus. EMBC Philip A. Warrick, Robert E. Kearney, Doina Precup, Emily F. Hamilton
2006	A	`conf`	Methods for Computing State Similarity in Markov Decision Processes. UAI Norm Ferns, Pablo Samuel Castro, Doina Precup, Prakash Panangaden
2006	—	`conf`	PAC-Learning of Markov Models with Hidden State. ECML Ricard Gavaldà, Philipp W. Keller, Joelle Pineau, Doina Precup
2006	A*	`conf`	Representing Systems with Hidden State. AAAI Christopher Hundt, Prakash Panangaden, Joelle Pineau, Doina Precup
2005	—	`conf`	Active Learning in Partially Observable Markov Decision Processes. ECML Robin Jaulmes, Joelle Pineau, Doina Precup
2005	—	`conf`	An approximation algorithm for labelled Markov processes: towards realistic approximation. QEST Alexandre Bouchard-Côté, Norm Ferns, Prakash Panangaden, Doina Precup
2005	A	`conf`	Metrics for Markov Decision Processes with Infinite State Spaces. UAI Norm Ferns, Prakash Panangaden, Doina Precup
2005	A*	`conf`	Model minimization by linear PSR. IJCAI Masoumeh T. Izadi, Doina Precup
2005	—	`conf`	Off-policy Learning with Options and Recognizers. NIPS Doina Precup, Richard S. Sutton, Cosmin Paduraru, Anna Koop, Satinder Singh
2005	J	`jnl`	The Workshop Program at the Nineteenth National Conference on Artificial Intelligence. AI Mag. Ion Muslea, Virginia Dignum, Daniel D. Corkill, Catholijn M. Jonker, Frank Dignum, Silvia Coradeschi, Alessandro Saffiotti, Dan Fu, Jeff Orkin, William Cheetham, Kai Goebel, Piero P. Bonissone, Leen-Kiat Soh, Randolph M. Jones, Robert E. Wray III, Matthias Scheutz, Daniela Pucci de Farias, Shie Mannor, Georgios Theocharous, Doina Precup, Bamshad Mobasher, Sarabjot S. Anand, Bettina Berendt, Andreas Hotho, Hans W. Guesgen, Michael T. Rosenstein, Mohammad Ghavamzadeh
2005	—	`conf`	Using Rewards for Belief State Updates in Partially Observable Markov Decision Processes. ECML Masoumeh T. Izadi, Doina Precup
2005	A*	`conf`	Using core beliefs for point-based value iteration. IJCAI Masoumeh T. Izadi, Ajit V. Rajwade, Doina Precup
2004	J	`jnl`	Classification Using Phi-Machines and Constructive Function Approximation. Mach. Learn. Doina Precup, Paul E. Utgoff
2004	A*	`conf`	Metrics for Finite Markov Decision Processes. AAAI Norm Ferns, Prakash Panangaden, Doina Precup
2004	A	`conf`	Metrics for Finite Markov Decision Processes. UAI Norm Ferns, Prakash Panangaden, Doina Precup
2004	A	`conf`	RedAgent-2003: An Autonomous Market-Based Supply-Chain Management Agent. AAMAS Philipp W. Keller, Felix-Olivier Duguay, Doina Precup
2004	J	`jnl`	Redagent: winner of TAC SCM 2003. SIGecom Exch. Philipp W. Keller, Felix-Olivier Duguay, Doina Precup
2004	—	`conf`	Sparse Distributed Memories for On-Line Value-Based Reinforcement Learning. ECML Bohdana Ratitch, Doina Precup
2003	A*	`conf`	A Planning Algorithm for Predictive State Representations. IJCAI Masoumeh T. Izadi, Doina Precup
2003	A*	`conf`	Combining TD-learning with Cascade-correlation Networks. ICML François Rivest, Doina Precup
2003	—	`conf`	Using MDP Characteristics to Guide Exploration in Reinforcement Learning. ECML Bohdana Ratitch, Doina Precup
2002	—	`conf`	A Convergent Form of Approximate Policy Iteration. NIPS Theodore J. Perkins, Doina Precup
2002	—	`conf`	Characterizing Markov Decision Processes. ECML Bohdana Ratitch, Doina Precup
2002	A*	`conf`	Combining and Adapting Software Quality Predictive Models by Genetic Algorithms. ASE Danielle Azar, Doina Precup, Salah Bouktif, Balázs Kégl, Houari A. Sahraoui
2002	J	`jnl`	Developing Collaborative Golog Agents by Reinforcement Learning. Int. J. Artif. Intell. Tools Ioan Alfred Letia, Doina Precup
2002	—	`conf`	Learning Options in Reinforcement Learning. SARA Martin Stolle, Doina Precup
2001	B	`conf`	Developing Collaborative Golog Agents by Reinforcement Learning. ICTAI Ioan Alfred Letia, Doina Precup
2001	A*	`conf`	Off-Policy Temporal Difference Learning with Function Approximation. ICML Doina Precup, Richard S. Sutton, Sanjoy Dasgupta
2000	A*	`conf`	Eligibility Traces for Off-Policy Policy Evaluation. ICML Doina Precup, Richard S. Sutton, Satinder Singh
2000	—	`conf`	Using Finite Experiments to Study Asymptotic Performance. Experimental Algorithmics Catherine C. McGeoch, Peter Sanders, Rudolf Fleischer, Paul R. Cohen, Doina Precup
1999	J	`jnl`	Between MDPs and Semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning. Artif. Intell. Richard S. Sutton, Doina Precup, Satinder Singh
1998	A*	`conf`	Classification Using Phi-Machines and Constructive Function Approximation. ICML Doina Precup, Paul E. Utgoff
1998	—	`conf`	Improved Switching among Temporally Abstract Actions. NIPS Richard S. Sutton, Satinder Singh, Doina Precup, Balaraman Ravindran
1998	A*	`conf`	Intra-Option Learning about Temporally Abstract Actions. ICML Richard S. Sutton, Doina Precup, Satinder Singh
1998	—	`conf`	Theoretical Results on Reinforcement Learning with Temporally Abstract Options. ECML Doina Precup, Richard S. Sutton, Satinder Singh
1997	A*	`conf`	Exponentiated Gradient Methods for Reinforcement Learning. ICML Doina Precup, Richard S. Sutton
1997	B	`conf`	How to Find Big-Oh in Your Data Set (and How Not to). IDA Catherine C. McGeoch, Doina Precup, Paul R. Cohen
1997	—	`conf`	Learning to Schedule Straight-Line Code. NIPS J. Eliot B. Moss, Paul E. Utgoff, John Cavazos, Doina Precup, Darko Stefanovic, Carla E. Brodley, David Scheeff
1997	—	`conf`	Multi-time Models for Temporally Abstract Planning. NIPS Doina Precup, Richard S. Sutton