Marlos C. Machado

92 papers A* 17A 4Journal 62Unranked 8

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	DROGO: Default Representation Objective via Graph Optimization in Reinforcement Learning. CoRR Hon Tik Tse, Marlos C. Machado
2026	J	`jnl`	Laplacian Representations for Decision-Time Planning. CoRR Dikshant Shehmar, Matthew Schlegel, Matthew E. Taylor, Marlos C. Machado
2026	J	`jnl`	The Laplacian Keyboard: Beyond the Linear Span. CoRR Siddarth Chandrasekar, Marlos C. Machado
2026	J	`jnl`	Universal computation is intrinsic to language model decoding. CoRR Alex Lewandowski, Marlos C. Machado, Dale Schuurmans
2025	J	`jnl`	A Study of Value-Aware Eigenoptions. CoRR Harshil Kotamreddy, Marlos C. Machado
2025	J	`jnl`	An Analysis of Action-Value Temporal-Difference Methods That Learn State Values. CoRR Brett Daley, Prabhat Nagarajan, Martha White, Marlos C. Machado
2025	J	`jnl`	Deep Reinforcement Learning with Gradient Eligibility Traces. CoRR Esraa Elelimy, Brett Daley, Andrew Patterson, Marlos C. Machado, Adam White, Martha White
2025	J	`jnl`	Discovering Temporal Structure: An Overview of Hierarchical Reinforcement Learning. CoRR Martin Klissarov, Akhil Bagaria, Ziyan Luo, George Dimitri Konidaris, Doina Precup, Marlos C. Machado
2025	J	`jnl`	Double Q-learning for Value-based Deep Reinforcement Learning, Revisited. CoRR Prabhat Nagarajan, Martha White, Marlos C. Machado
2025	A*	`conf`	Learning Continually by Spectral Regularization. ICLR Alex Lewandowski, Michal Bortkiewicz, Saurabh Kumar, András György, Dale Schuurmans, Mateusz Ostaszewski, Marlos C. Machado
2025	A*	`conf`	MaestroMotif: Skill Design from Artificial Intelligence Feedback. ICLR Martin Klissarov, Mikael Henaff, Roberta Raileanu, Shagun Sodhani, Pascal Vincent, Amy Zhang, Pierre-Luc Bacon, Doina Precup, Marlos C. Machado, Pierluca D'Oro
2025	A*	`conf`	Plastic Learning with Deep Fourier Features. ICLR Alex Lewandowski, Dale Schuurmans, Marlos C. Machado
2025	A*	`conf`	Representation-driven Option Discovery in Reinforcement Learning. AAAI Marlos C. Machado
2025	J	`jnl`	Reward-Aware Proto-Representations in Reinforcement Learning. CoRR Hon Tik Tse, Siddarth Chandrasekar, Marlos C. Machado
2025	J	`jnl`	The Cell Must Go On: Agar.io for Continual Reinforcement Learning. CoRR Mohamed A. Mohamed, Kateryna Nekhomiazh, Vedant Vyas, Marcos M. Jose, Andrew Patterson, Marlos C. Machado
2025	J	`jnl`	The World Is Bigger! A Computationally-Embedded Perspective on the Big World Hypothesis. CoRR Alex Lewandowski, Adtiya A. Ramesh, Edan Meyer, Dale Schuurmans, Marlos C. Machado
2024	J	`jnl`	AGaLiTe: Approximate Gated Linear Transformers for Online Reinforcement Learning. Trans. Mach. Learn. Res. Subhojeet Pramanik, Esraa Elelimy, Marlos C. Machado, Adam White
2024	A*	`conf`	Averaging n-step Returns Reduces Variance in Reinforcement Learning. ICML Brett Daley, Martha White, Marlos C. Machado
2024	J	`jnl`	Compound Returns Reduce Variance in Reinforcement Learning. CoRR Brett Daley, Martha White, Marlos C. Machado
2024	J	`jnl`	Demystifying the Recency Heuristic in Temporal-Difference Learning. RLJ Brett Daley, Marlos C. Machado, Martha White
2024	J	`jnl`	Demystifying the Recency Heuristic in Temporal-Difference Learning. CoRR Brett Daley, Marlos C. Machado, Martha White
2024	J	`jnl`	GVFs in the real world: making predictions online for water treatment. Mach. Learn. Muhammad Kamran Janjua, Haseeb Shah, Martha White, Erfan Miahi, Marlos C. Machado, Adam White
2024	J	`jnl`	Harnessing Discrete Representations for Continual Reinforcement Learning. RLJ Edan Meyer, Adam White, Marlos C. Machado
2024	J	`jnl`	Investigating the properties of neural network representations in reinforcement learning. Artif. Intell. Han Wang, Erfan Miahi, Martha White, Marlos C. Machado, Zaheer Abbas, Raksha Kumaraswamy, Vincent Liu, Adam White
2024	J	`jnl`	Learning Continually by Spectral Regularization. CoRR Alex Lewandowski, Saurabh Kumar, Dale Schuurmans, András György, Marlos C. Machado
2024	J	`jnl`	MaestroMotif: Skill Design from Artificial Intelligence Feedback. CoRR Martin Klissarov, Mikael Henaff, Roberta Raileanu, Shagun Sodhani, Pascal Vincent, Amy Zhang, Pierre-Luc Bacon, Doina Precup, Marlos C. Machado, Pierluca D'Oro
2024	J	`jnl`	Plastic Learning with Deep Fourier Features. CoRR Alex Lewandowski, Dale Schuurmans, Marlos C. Machado
2024	A*	`conf`	Proper Laplacian Representation Learning. ICLR Diego Gomez, Michael Bowling, Marlos C. Machado
2024	A*	`conf`	Reward-Respecting Subtasks for Model-Based Reinforcement Learning (Abstract Reprint). AAAI Richard S. Sutton, Marlos C. Machado, G. Zacharias Holland, David Szepesvari, Finbarr Timbers, Brian Tanner, Adam White
2023	J	`jnl`	Agent-State Construction with Auxiliary Inputs. Trans. Mach. Learn. Res. Ruo Yu Tao, Adam White, Marlos C. Machado
2023	J	`jnl`	Curvature Explains Loss of Plasticity. CoRR Alex Lewandowski, Haruto Tanaka, Dale Schuurmans, Marlos C. Machado
2023	A*	`conf`	Deep Laplacian-based Options for Temporally-Extended Exploration. ICML Martin Klissarov, Marlos C. Machado
2023	J	`jnl`	Deep Laplacian-based Options for Temporally-Extended Exploration. CoRR Martin Klissarov, Marlos C. Machado
2023	J	`jnl`	GVFs in the Real World: Making Predictions Online for Water Treatment. CoRR Muhammad Kamran Janjua, Haseeb Shah, Martha White, Erfan Miahi, Marlos C. Machado, Adam White
2023	J	`jnl`	Harnessing Discrete Representations For Continual Reinforcement Learning. CoRR Edan Meyer, Adam White, Marlos C. Machado
2023	—	`conf`	Loss of Plasticity in Continual Deep Reinforcement Learning. CoLLAs Zaheer Abbas, Rosie Zhao, Joseph Modayil, Adam White, Marlos C. Machado
2023	J	`jnl`	Loss of Plasticity in Continual Deep Reinforcement Learning. CoRR Zaheer Abbas, Rosie Zhao, Joseph Modayil, Adam White, Marlos C. Machado
2023	J	`jnl`	Proper Laplacian Representation Learning. CoRR Diego Gomez, Michael Bowling, Marlos C. Machado
2023	J	`jnl`	Recurrent Linear Transformers. CoRR Subhojeet Pramanik, Esraa Elelimy, Marlos C. Machado, Adam White
2023	J	`jnl`	Reward-respecting subtasks for model-based reinforcement learning. Artif. Intell. Richard S. Sutton, Marlos C. Machado, G. Zacharias Holland, David Szepesvari, Finbarr Timbers, Brian Tanner, Adam White
2023	J	`jnl`	Temporal Abstraction in Reinforcement Learning with the Successor Representation. J. Mach. Learn. Res. Marlos C. Machado, André Barreto, Doina Precup, Michael Bowling
2023	A*	`conf`	Trajectory-Aware Eligibility Traces for Off-Policy Reinforcement Learning. ICML Brett Daley, Martha White, Christopher Amato, Marlos C. Machado
2023	J	`jnl`	Trajectory-Aware Eligibility Traces for Off-Policy Reinforcement Learning. CoRR Brett Daley, Martha White, Christopher Amato, Marlos C. Machado
2022	A	`conf`	A general class of surrogate functions for stable and efficient reinforcement learning. AISTATS Sharan Vaswani, Olivier Bachem, Simone Totaro, Robert Müller, Shivam Garg, Matthieu Geist, Marlos C. Machado, Pablo Samuel Castro, Nicolas Le Roux
2022	J	`jnl`	Agent-State Construction with Auxiliary Inputs. CoRR Ruo Yu Tao, Adam White, Marlos C. Machado
2022	J	`jnl`	Investigating the Properties of Neural Network Representations in Reinforcement Learning. CoRR Han Wang, Erfan Miahi, Martha White, Marlos C. Machado, Zaheer Abbas, Raksha Kumaraswamy, Vincent Liu, Adam White
2022	J	`jnl`	Reward-Respecting Subtasks for Model-Based Reinforcement Learning. CoRR Richard S. Sutton, Marlos C. Machado, G. Zacharias Holland, David Szepesvari, Finbarr Timbers, Brian Tanner, Adam White
2022	J	`jnl`	Temporal Abstractions-Augmented Temporally Contrastive Learning: An Alternative to the Laplacian in RL. CoRR Akram Erraqabi, Marlos C. Machado, Mingde Zhao, Sainbayar Sukhbaatar, Alessandro Lazaric, Ludovic Denoyer, Yoshua Bengio
2022	A	`conf`	Temporal abstractions-augmented temporally contrastive learning: An alternative to the Laplacian in RL. UAI Akram Erraqabi, Marlos C. Machado, Mingde Zhao, Sainbayar Sukhbaatar, Alessandro Lazaric, Ludovic Denoyer, Yoshua Bengio
2021	J	`jnl`	A functional mirror ascent view of policy gradient methods with function approximation. CoRR Sharan Vaswani, Olivier Bachem, Simone Totaro, Robert Mueller, Matthieu Geist, Marlos C. Machado, Pablo Samuel Castro, Nicolas Le Roux
2021	A*	`conf`	Beyond Variance Reduction: Understanding the True Impact of Baselines on Policy Optimization. ICML Wesley Chung, Valentin Thomas, Marlos C. Machado, Nicolas Le Roux
2021	A*	`conf`	Contrastive Behavioral Similarity Embeddings for Generalization in Reinforcement Learning. ICLR Rishabh Agarwal, Marlos C. Machado, Pablo Samuel Castro, Marc G. Bellemare
2021	J	`jnl`	Contrastive Behavioral Similarity Embeddings for Generalization in Reinforcement Learning. CoRR Rishabh Agarwal, Marlos C. Machado, Pablo Samuel Castro, Marc G. Bellemare
2021	J	`jnl`	On Bonus-Based Exploration Methods in the Arcade Learning Environment. CoRR Adrien Ali Taïga, William Fedus, Marlos C. Machado, Aaron C. Courville, Marc G. Bellemare
2021	J	`jnl`	Temporal Abstraction in Reinforcement Learning with the Successor Representation. CoRR Marlos C. Machado, André Barreto, Doina Precup
2020	A*	`conf`	An operator view of policy gradient methods. NeurIPS Dibya Ghosh, Marlos C. Machado, Nicolas Le Roux
2020	J	`jnl`	An operator view of policy gradient methods. CoRR Dibya Ghosh, Marlos C. Machado, Nicolas Le Roux
2020	J	`jnl`	Autonomous navigation of stratospheric balloons using reinforcement learning. Nat. Marc G. Bellemare, Salvatore Candido, Pablo Samuel Castro, Jun Gong, Marlos C. Machado, Subhodeep Moitra, Sameera S. Ponda, Ziyu Wang
2020	J	`jnl`	Beyond variance reduction: Understanding the true impact of baselines on policy optimization. CoRR Wesley Chung, Valentin Thomas, Marlos C. Machado, Nicolas Le Roux
2020	A*	`conf`	Count-Based Exploration with the Successor Representation. AAAI Marlos C. Machado, Marc G. Bellemare, Michael Bowling
2020	A*	`conf`	Exploration in Reinforcement Learning with Deep Covering Options. ICLR Yuu Jinnai, Jee Won Park, Marlos C. Machado, George Dimitri Konidaris
2020	A*	`conf`	On Bonus Based Exploration Methods In The Arcade Learning Environment. ICLR Adrien Ali Taïga, William Fedus, Marlos C. Machado, Aaron C. Courville, Marc G. Bellemare
2019	J	`jnl`	Benchmarking Bonus-Based Exploration Methods on the Arcade Learning Environment. CoRR Adrien Ali Taïga, William Fedus, Marlos C. Machado, Aaron C. Courville, Marc G. Bellemare
2018	A	`conf`	Accelerating Learning in Constructive Predictive Frameworks with the Successor Representation. IROS Craig Sherstan, Marlos C. Machado, Patrick M. Pilarski
2018	J	`jnl`	Accelerating Learning in Constructive Predictive Frameworks with the Successor Representation. CoRR Craig Sherstan, Marlos C. Machado, Patrick M. Pilarski
2018	J	`jnl`	Count-Based Exploration with the Successor Representation. CoRR Marlos C. Machado, Marc G. Bellemare, Michael Bowling
2018	—	`conf`	Eigenoption Discovery through the Deep Successor Representation. ICLR (Poster) Marlos C. Machado, Clemens Rosenbaum, Xiaoxiao Guo, Miao Liu, Gerald Tesauro, Murray Campbell
2018	J	`jnl`	Generalization and Regularization in DQN. CoRR Jesse Farebrother, Marlos C. Machado, Michael Bowling
2018	A*	`conf`	Revisiting the Arcade Learning Environment: Evaluation Protocols and Open Problems for General Agents (Extended Abstract). IJCAI Marlos C. Machado, Marc G. Bellemare, Erik Talvitie, Joel Veness, Matthew J. Hausknecht, Michael Bowling
2018	J	`jnl`	Revisiting the Arcade Learning Environment: Evaluation Protocols and Open Problems for General Agents. J. Artif. Intell. Res. Marlos C. Machado, Marc G. Bellemare, Erik Talvitie, Joel Veness, Matthew J. Hausknecht, Michael Bowling
2017	A*	`conf`	A Laplacian Framework for Option Discovery in Reinforcement Learning. ICML Marlos C. Machado, Marc G. Bellemare, Michael H. Bowling
2017	J	`jnl`	A Laplacian Framework for Option Discovery in Reinforcement Learning. CoRR Marlos C. Machado, Marc G. Bellemare, Michael H. Bowling
2017	J	`jnl`	Eigenoption Discovery through the Deep Successor Representation. CoRR Marlos C. Machado, Clemens Rosenbaum, Xiaoxiao Guo, Miao Liu, Gerald Tesauro, Murray Campbell
2017	J	`jnl`	Revisiting the Arcade Learning Environment: Evaluation Protocols and Open Problems for General Agents. CoRR Marlos C. Machado, Marc G. Bellemare, Erik Talvitie, Joel Veness, Matthew J. Hausknecht, Michael Bowling
2017	J	`jnl`	The Eigenoption-Critic Framework. CoRR Miao Liu, Marlos C. Machado, Gerald Tesauro, Murray Campbell
2016	—	`conf`	Introspective Agents: Confidence Measures for General Value Functions. AGI Craig Sherstan, Adam White, Marlos C. Machado, Patrick M. Pilarski
2016	J	`jnl`	Introspective Agents: Confidence Measures for General Value Functions. CoRR Craig Sherstan, Adam White, Marlos C. Machado, Patrick M. Pilarski
2016	J	`jnl`	Learning Purposeful Behaviour in the Absence of Rewards. CoRR Marlos C. Machado, Michael H. Bowling
2016	A	`conf`	State of the Art Control of Atari Games Using Shallow Reinforcement Learning. AAMAS Yitao Liang, Marlos C. Machado, Erik Talvitie, Michael H. Bowling
2016	J	`jnl`	True Online Temporal-Difference Learning. J. Mach. Learn. Res. Harm van Seijen, Ashique Rupam Mahmood, Patrick M. Pilarski, Marlos C. Machado, Richard S. Sutton
2015	—	`conf`	Domain-Independent Optimistic Initialization for Reinforcement Learning. AAAI Workshop: Learning for General Competency in Video Games Marlos C. Machado, Sriram Srinivasan, Michael H. Bowling
2015	—	`ed.`	Learning for General Competency in Video Games, Papers from the 2015 AAAI Workshop, Austin, Texas, USA, January 26, 2015. AAAI Workshop: Learning for General Competency in Video Games Michael Bowling, Marc G. Bellemare, Erik Talvitie, Joel Veness, Marlos C. Machado
2015	J	`jnl`	Reports from the 2015 AAAI Workshop Program. AI Mag. Stefano V. Albrecht, J. Christopher Beck, David L. Buckeridge, Adi Botea, Cornelia Caragea, Chi-Hung Chi, Theodoros Damoulas, Bistra Dilkina, Eric Eaton, Pooyan Fazli, Sam Ganzfried, Marius Lindauer, Marlos C. Machado, Yuri Malitsky, Gary Marcus, Sebastiaan A. Meijer, Francesca Rossi, Arash Shaban-Nejad, Sylvie Thiébaux, Manuela M. Veloso, Toby Walsh, Can Wang, Jie Zhang, Yu Zheng
2015	J	`jnl`	State of the Art Control of Atari Games Using Shallow Reinforcement Learning. CoRR Yitao Liang, Marlos C. Machado, Erik Talvitie, Michael H. Bowling
2015	J	`jnl`	True Online Temporal-Difference Learning. CoRR Harm van Seijen, Ashique Rupam Mahmood, Patrick M. Pilarski, Marlos C. Machado, Richard S. Sutton
2014	J	`jnl`	Domain-Independent Optimistic Initialization for Reinforcement Learning. CoRR Marlos C. Machado, Sriram Srinivasan, Michael Bowling
2014	J	`jnl`	RTSMate: Towards an Advice System for RTS Games. Comput. Entertain. Renato Luiz de Freitas Cunha, Marlos C. Machado, Luiz Chaimowicz
2013	J	`jnl`	A Methodology for Player Modeling based on Machine Learning. CoRR Marlos C. Machado
2012	—	`conf`	A binary classification approach for automatic preference modeling of virtual agents in Civilization IV. CIG Marlos C. Machado, Gisele L. Pappa, Luiz Chaimowicz
2011	—	`conf`	Agents Behavior and Preferences Characterization in Civilization IV. SBGames Marlos C. Machado, Bruno S. L. Rocha, Luiz Chaimowicz
2011	—	`conf`	Combining Metaheuristics and CSP Algorithms to Solve Sudoku. SBGames Marlos C. Machado, Luiz Chaimowicz
2011	—	`conf`	Player modeling: Towards a common taxonomy. CGAMES Marlos C. Machado, Eduardo P. C. Fantini, Luiz Chaimowicz