Jonathan Pilault

22 papers A* 4Journal 15Unranked 3
YearRankTypeTitle / Venue / Authors
2024 A* conf
Course Correcting Koopman Representations.
ICLR
Mahan Fathi, Clement Gehring, Jonathan Pilault, David Kanaa, Pierre-Luc Bacon, Ross Goroshin
2024 — conf
Jaxpruner: A Concise Library for Sparsity Research.
CPAL
Joo Hyung Lee, Wonpyo Park, Nicole Mitchell, Jonathan Pilault, Johan Samir Obando Ceron, Han-Byul Kim, Namhoon Lee, Elias Frantar, Yun Long, Amir Yazdanbakhsh, Woohyun Han, Shivani Agrawal, Suvinay Subramanian, Xin Wang, Sheng-Chun Kao, Xingyao Zhang, Trevor Gale, Aart J. C. Bik, Milen Ferev, Zhonglin Han, Hong-Seok Kim, Yann N. Dauphin, Gintare Karolina Dziugaite, Pablo Samuel Castro, Utku Evci
2024 J jnl
The Zamba2 Suite: Technical Report.
CoRR
Paolo Glorioso, Quentin Anthony, Yury Tokpanov, Anna Golubeva, Vasudev Shyam, James Whittington, Jonathan Pilault, Beren Millidge
2024 J jnl
Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters.
CoRR
Vasudev Shyam, Jonathan Pilault, Emily Shepperd, Quentin Anthony, Beren Millidge
2024 J jnl
Zamba: A Compact 7B SSM Hybrid Model.
CoRR
Paolo Glorioso, Quentin Anthony, Yury Tokpanov, James Whittington, Jonathan Pilault, Adam Ibrahim, Beren Millidge
2024 J jnl
Zyda: A 1.3T Dataset for Open Language Modeling.
CoRR
Yury Tokpanov, Beren Millidge, Paolo Glorioso, Jonathan Pilault, Adam Ibrahim, James Whittington, Quentin Anthony
2023 J jnl
Block-State Transformer.
CoRR
Mahan Fathi, Jonathan Pilault, Pierre-Luc Bacon, Christopher Pal, Orhan Firat, Ross Goroshin
2023 A* conf
Block-State Transformers.
NeurIPS
Jonathan Pilault, Mahan Fathi, Orhan Firat, Chris Pal, Pierre-Luc Bacon, Ross Goroshin
2023 J jnl
Course Correcting Koopman Representations.
CoRR
Mahan Fathi, Clement Gehring, Jonathan Pilault, David Kanaa, Pierre-Luc Bacon, Ross Goroshin
2023 — conf
Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction.
IJCNLP (1)
Jonathan Pilault, Xavier Garcia, Arthur Brazinskas, Orhan Firat
2023 J jnl
Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction.
CoRR
Jonathan Pilault, Xavier Garcia, Arthur Brazinskas, Orhan Firat
2023 J jnl
JaxPruner: A concise library for sparsity research.
CoRR
Joo Hyung Lee, Wonpyo Park, Nicole Mitchell, Jonathan Pilault, Johan S. Obando-Ceron, Han-Byul Kim, Namhoon Lee, Elias Frantar, Yun Long, Amir Yazdanbakhsh, Shivani Agrawal, Suvinay Subramanian, Xin Wang, Sheng-Chun Kao, Xingyao Zhang, Trevor Gale, Aart J. C. Bik, Woohyun Han, Milen Ferev, Zhonglin Han, Hong-Seok Kim, Yann N. Dauphin, Karolina Dziugaite, Pablo Samuel Castro, Utku Evci
2023 A* conf
On Conditional and Compositional Language Model Differentiable Prompting.
IJCAI
Jonathan Pilault, Can Liu, Mohit Bansal, Markus Dreyer
2023 J jnl
On Conditional and Compositional Language Model Differentiable Prompting.
CoRR
Jonathan Pilault, Can Liu, Mohit Bansal, Markus Dreyer
2022 J jnl
Using Graph Algorithms to Pretrain Graph Completion Transformers.
CoRR
Jonathan Pilault, Michael Galkin, Bahare Fatemi, Perouz Taslakian, David Vázquez, Christopher Pal
2021 A* conf
Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data.
ICLR
Jonathan Pilault, Amine Elhattami, Christopher J. Pal
2021 J jnl
Towards Neural Functional Program Evaluation.
CoRR
Torsten Scholak, Jonathan Pilault, Joey Velez-Ginorio
2020 J jnl
Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data.
CoRR
Jonathan Pilault, Amine Elhattami, Christopher J. Pal
2020 J jnl
Learning to Summarize Long Texts with Memory Compression and Transfer.
CoRR
Jaehong Park, Jonathan Pilault, Christopher Joseph Pal
2020 — conf
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models.
EMNLP (1)
Jonathan Pilault, Raymond Li, Sandeep Subramanian, Chris Pal
2020 J jnl
On the impressive performance of randomly weighted encoders in summarization tasks.
CoRR
Jonathan Pilault, Jaehong Park, Christopher J. Pal
2019 J jnl
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models.
CoRR
Sandeep Subramanian, Raymond Li, Jonathan Pilault, Christopher J. Pal