Johan Ferret

31 papers A* 8A 2Journal 18Unranked 2
YearRankTypeTitle / Venue / Authors
2025 A* conf
BOND: Aligning LLMs with Best-of-N Distillation.
ICLR
Pier Giuseppe Sessa, Robert Dadashi-Tazehozi, Léonard Hussenot, Johan Ferret, Nino Vieillard, Alexandre Ramé, Bobak Shahriari, Sarah Perrin, Abram L. Friesen, Geoffrey Cideron, Sertan Girgin, Piotr Stanczyk, Andrea Michi, Danila Sinopalnikov, Sabela Ramos Garea, Amélie Héliou, Aliaksei Severyn, Matthew Hoffman, Nikola Momchev, Olivier Bachem
2025 A* conf
Diversity-Rewarded CFG Distillation.
ICLR
Geoffrey Cideron, Andrea Agostinelli, Johan Ferret, Sertan Girgin, Romuald Elie, Olivier Bachem, Sarah Perrin, Alexandre Ramé
2025 A* conf
On Teacher Hacking in Language Model Distillation.
ICML
Daniil Tiapkin, Daniele Calandriello, Johan Ferret, Sarah Perrin, Nino Vieillard, Alexandre Ramé, Mathieu Blondel
2025 J jnl
On Teacher Hacking in Language Model Distillation.
CoRR
Daniil Tiapkin, Daniele Calandriello, Johan Ferret, Sarah Perrin, Nino Vieillard, Alexandre Ramé, Mathieu Blondel
2024 J jnl
A Survey of Temporal Credit Assignment in Deep Reinforcement Learning.
Trans. Mach. Learn. Res.
Eduardo Pignatelli, Johan Ferret, Matthieu Geist, Thomas Mesnard, Hado van Hasselt, Laura Toni
2024 J jnl
Assessing the Zero-Shot Capabilities of LLMs for Action Evaluation in RL.
CoRR
Eduardo Pignatelli, Johan Ferret, Tim Rocktäschel, Edward Grefenstette, Davide Paglieri, Samuel Coward, Laura Toni
2024 J jnl
BOND: Aligning LLMs with Best-of-N Distillation.
CoRR
Pier Giuseppe Sessa, Robert Dadashi, Léonard Hussenot, Johan Ferret, Nino Vieillard, Alexandre Ramé, Bobak Shahriari, Sarah Perrin, Abe Friesen, Geoffrey Cideron, Sertan Girgin, Piotr Stanczyk, Andrea Michi, Danila Sinopalnikov, Sabela Ramos, Amélie Héliou, Aliaksei Severyn, Matt Hoffman, Nikola Momchev, Olivier Bachem
2024 — conf
Conditional Language Policy: A General Framework For Steerable Multi-Objective Finetuning.
EMNLP (Findings)
Kaiwen Wang, Rahul Kidambi, Ryan Sullivan, Alekh Agarwal, Christoph Dann, Andrea Michi, Marco Gelmi, Yunxuan Li, Raghav Gupta, Avinava Dubey, Alexandre Ramé, Johan Ferret, Geoffrey Cideron, Le Hou, Hongkun Yu, Amr Ahmed, Aranyak Mehta, Léonard Hussenot, Olivier Bachem, Edouard Leurent
2024 J jnl
Conditioned Language Policy: A General Framework for Steerable Multi-Objective Finetuning.
CoRR
Kaiwen Wang, Rahul Kidambi, Ryan Sullivan, Alekh Agarwal, Christoph Dann, Andrea Michi, Marco Gelmi, Yunxuan Li, Raghav Gupta, Avinava Dubey, Alexandre Ramé, Johan Ferret, Geoffrey Cideron, Le Hou, Hongkun Yu, Amr Ahmed, Aranyak Mehta, Léonard Hussenot, Olivier Bachem, Edouard Leurent
2024 J jnl
Direct Language Model Alignment from Online AI Feedback.
CoRR
Shangmin Guo, Biao Zhang, Tianlin Liu, Tianqi Liu, Misha Khalman, Felipe Llinares, Alexandre Ramé, Thomas Mesnard, Yao Zhao, Bilal Piot, Johan Ferret, Mathieu Blondel
2024 J jnl
Diversity-Rewarded CFG Distillation.
CoRR
Geoffrey Cideron, Andrea Agostinelli, Johan Ferret, Sertan Girgin, Romuald Elie, Olivier Bachem, Sarah Perrin, Alexandre Ramé
2024 A* conf
RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedback.
ICML
Harrison Lee, Samrat Phatale, Hassan Mansoor, Thomas Mesnard, Johan Ferret, Kellie Lu, Colton Bishop, Ethan Hall, Victor Carbune, Abhinav Rastogi, Sushant Prakash
2024 J jnl
RecurrentGemma: Moving Past Transformers for Efficient Open Language Models.
CoRR
Aleksandar Botev, Soham De, Samuel L. Smith, Anushan Fernando, George-Cristian Muraru, Ruba Haroun, Leonard Berrada, Razvan Pascanu, Pier Giuseppe Sessa, Robert Dadashi, Léonard Hussenot, Johan Ferret, Sertan Girgin, Olivier Bachem, Alek Andreev, Kathleen Kenealy, Thomas Mesnard, Cassidy Hardin, Surya Bhupatiraju, Shreya Pathak, Laurent Sifre, Morgane Rivière, Mihir Sanjay Kale, Juliette Love, Pouya Tafti, Armand Joulin, Noah Fiedel, Evan Senter, Yutian Chen, Srivatsan Srinivasan, Guillaume Desjardins, David Budden, Arnaud Doucet, Sharad Vikram, Adam Paszke, Trevor Gale, Sebastian Borgeaud, Charlie Chen, Andy Brock, Antonia Paterson, Jenny Brennan, Meg Risdal, Raj Gundluru, Nesh Devanathan, Paul Mooney, Nilay Chauhan, Phil Culliton, Luiz Gustavo Martins, Elisa Bandy, David Huntsperger, Glenn Cameron, Arthur Zucker, Tris Warkentin, Ludovic Peran, Minh Giang, Zoubin Ghahramani, Clément Farabet, Koray Kavukcuoglu, Demis Hassabis, Raia Hadsell, Yee Whye Teh, Nando de Frietas
2024 A* conf
WARM: On the Benefits of Weight Averaged Reward Models.
ICML
Alexandre Ramé, Nino Vieillard, Léonard Hussenot, Robert Dadashi, Geoffrey Cideron, Olivier Bachem, Johan Ferret
2024 J jnl
WARM: On the Benefits of Weight Averaged Reward Models.
CoRR
Alexandre Ramé, Nino Vieillard, Léonard Hussenot, Robert Dadashi, Geoffrey Cideron, Olivier Bachem, Johan Ferret
2024 J jnl
WARP: On the Benefits of Weight Averaged Rewarded Policies.
CoRR
Alexandre Ramé, Johan Ferret, Nino Vieillard, Robert Dadashi, Léonard Hussenot, Pierre-Louis Cedoz, Pier Giuseppe Sessa, Sertan Girgin, Arthur Douillard, Olivier Bachem
2023 J jnl
A Survey of Temporal Credit Assignment in Deep Reinforcement Learning.
CoRR
Eduardo Pignatelli, Johan Ferret, Matthieu Geist, Thomas Mesnard, Hado van Hasselt, Laura Toni
2023 — conf
Factually Consistent Summarization via Reinforcement Learning with Textual Entailment Feedback.
ACL (1)
Paul Roit, Johan Ferret, Lior Shani, Roee Aharoni, Geoffrey Cideron, Robert Dadashi, Matthieu Geist, Sertan Girgin, Léonard Hussenot, Orgad Keller, Nikola Momchev, Sabela Ramos Garea, Piotr Stanczyk, Nino Vieillard, Olivier Bachem, Gal Elidan, Avinatan Hassidim, Olivier Pietquin, Idan Szpektor
2023 J jnl
Factually Consistent Summarization via Reinforcement Learning with Textual Entailment Feedback.
CoRR
Paul Roit, Johan Ferret, Lior Shani, Roee Aharoni, Geoffrey Cideron, Robert Dadashi, Matthieu Geist, Sertan Girgin, Léonard Hussenot, Orgad Keller, Nikola Momchev, Sabela Ramos, Piotr Stanczyk, Nino Vieillard, Olivier Bachem, Gal Elidan, Avinatan Hassidim, Olivier Pietquin, Idan Szpektor
2022 A conf
Lazy-MDPs: Towards Interpretable RL by Learning When to Act.
AAMAS
Alexis Jacq, Johan Ferret, Olivier Pietquin, Matthieu Geist
2022 J jnl
Lazy-MDPs: Towards Interpretable Reinforcement Learning by Learning When to Act.
CoRR
Alexis Jacq, Johan Ferret, Olivier Pietquin, Matthieu Geist
2022 — —
On actions that matter: credit assignment and interpretability in reinforcement learning. (De l'importance des actions: assignation de crédit et interprétabilité pour l'apprentissage par renforcement).
Johan Ferret
2021 A* conf
Adversarially Guided Actor-Critic.
ICLR
Yannis Flet-Berliac, Johan Ferret, Olivier Pietquin, Philippe Preux, Matthieu Geist
2021 J jnl
Adversarially Guided Actor-Critic.
CoRR
Yannis Flet-Berliac, Johan Ferret, Olivier Pietquin, Philippe Preux, Matthieu Geist
2021 J jnl
More Efficient Exploration with Symbolic Priors on Action Sequence Equivalences.
CoRR
Toby Johnstone, Nathan Grinsztajn, Johan Ferret, Philippe Preux
2021 A conf
Self-Imitation Advantage Learning.
AAMAS
Johan Ferret, Olivier Pietquin, Matthieu Geist
2021 A* conf
There Is No Turning Back: A Self-Supervised Approach for Reversibility-Aware Reinforcement Learning.
NeurIPS
Nathan Grinsztajn, Johan Ferret, Olivier Pietquin, Philippe Preux, Matthieu Geist
2021 J jnl
There Is No Turning Back: A Self-Supervised Approach for Reversibility-Aware Reinforcement Learning.
CoRR
Nathan Grinsztajn, Johan Ferret, Olivier Pietquin, Philippe Preux, Matthieu Geist
2020 A* conf
Self-Attentional Credit Assignment for Transfer in Reinforcement Learning.
IJCAI
Johan Ferret, Raphaël Marinier, Matthieu Geist, Olivier Pietquin
2020 J jnl
Self-Imitation Advantage Learning.
CoRR
Johan Ferret, Olivier Pietquin, Matthieu Geist
2019 J jnl
Credit Assignment as a Proxy for Transfer in Reinforcement Learning.
CoRR
Johan Ferret, Raphaël Marinier, Matthieu Geist, Olivier Pietquin