Adam Roberts

85 papers A* 11Journal 52Unranked 21
YearRankTypeTitle / Venue / Authors
2025 J jnl
Adaptive Accompaniment with ReaLchords.
CoRR
Yusong Wu, Tim Cooijmans, Kyle Kastner, Adam Roberts, Ian Simon, Alexander Scarlatos, Chris Donahue, Cassie Tarakajian, Shayegan Omidshafiei, Aaron C. Courville, Pablo Samuel Castro, Natasha Jaques, Cheng-Zhi Anna Huang
2025 J jnl
EmbeddingGemma: Powerful and Lightweight Text Representations.
CoRR
Henrique Schechter Vera, Sahil Dua, Biao Zhang, Daniel Salz, Ryan Mullins, Sindhu Raghuram Panyam, Sara Smoot, Iftekhar Naim, Joe Zou, Feiyang Chen, Daniel Cer, Alice Lisak, Min Choi, Lucas Gonzalez, Omar Sanseviero, Glenn Cameron, Ian Ballantyne, Kat Black, Kaifeng Chen, Weiyi Wang, Zhe Li, Gus Martins, Jinhyuk Lee, Mark Sherwood, Ju-yeong Ji, Renjie Wu, Jingxiao Zheng, Jyotinder Singh, Abheesht Sharma, Divyashree Sreepathihalli, Aashi Jain, Adham Elarabawy, AJ Co, Andreas Doumanoglou, Babak Samari, Ben Hora, Brian Potetz, Dahun Kim, Enrique Alfonseca, Fedor Moiseev, Feng Han, Frank Palma Gomez, Gustavo Hernández Ábrego, Hesen Zhang, Hui Hui, Jay Han, Karan Gill, Ke Chen, Koert Chen, Madhuri Shanbhogue, Michael Boratko, Paul Suganthan, Sai Meher Karthik Duddu, Sandeep Mariserla, Setareh Ariafar, Shanfeng Zhang, Shijie Zhang, Simon Baumgartner, Sonam Goenka, Steve Qiu, Tanmaya Dabral, Trevor Walker, Vikram Rao, Waleed Khawaja, Wenlei Zhou, Xiaoqi Ren, Ye Xia, Yichang Chen, Yi-Ting Chen, Zhe Dong, Zhongli Ding, Francesco Visin, Gaël Liu, Jiageng Zhang, Kathleen Kenealy, Michelle Casbon, Ravin Kumar, Thomas Mesnard, Zach Gleicher, Cormac Brick, Olivier Lacombe, Adam Roberts, Qin Yin, Yun-Hsuan Sung, Raphael Hoffmann, Tris Warkentin, Armand Joulin, Tom Duerig, Mojtaba Seyedhosseini
2025 J jnl
Live Music Models.
CoRR
Antoine Caillon, Brian McWilliams, Cassie Tarakajian, Ian Simon, Ilaria Manco, Jesse H. Engel, Noah Constant, Yunpeng Li, Timo I. Denk, Alberto Lalama, Andrea Agostinelli, Cheng-Zhi Anna Huang, Ethan Manilow, George Brower, Hakan Erdogan, Heidi Lei, Itai Rolnick, Ivan Grishchenko, Manu Orsini, Matej Kastelic, Mauricio Zuluaga, Mauro Verzetti, Michael Dooley, Ondrej Skopek, Rafael Ferrer, Zalán Borsos, Aäron van den Oord, Douglas Eck, Eli Collins, Jason Baldridge, Tom Hume, Chris Donahue, Kehang Han, Adam Roberts
2025 — conf
ReaLJam: Real-Time Human-AI Music Jamming with Reinforcement Learning-Tuned Transformers.
CHI Extended Abstracts
Alexander Scarlatos, Yusong Wu, Ian Simon, Adam Roberts, Tim Cooijmans, Natasha Jaques, Cassie Tarakajian, Cheng-Zhi Anna Huang
2025 J jnl
ReaLJam: Real-Time Human-AI Music Jamming with Reinforcement Learning-Tuned Transformers.
CoRR
Alexander Scarlatos, Yusong Wu, Ian Simon, Adam Roberts, Tim Cooijmans, Natasha Jaques, Cassie Tarakajian, Cheng-Zhi Anna Huang
2025 J jnl
T5Gemma 2: Seeing, Reading, and Understanding Longer.
CoRR
Biao Zhang, Paul Suganthan, Gaël Liu, Ilya Philippov, Sahil Dua, Ben Hora, Kat Black, Gus Martins, Omar Sanseviero, Shreya Pathak, Cassidy Hardin, Francesco Visin, Jiageng Zhang, Kathleen Kenealy, Qin Yin, Xiaodan Song, Olivier Lacombe, Armand Joulin, Tris Warkentin, Adam Roberts
2024 — conf
A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity.
NAACL-HLT
Shayne Longpre, Gregory Yauney, Emily Reif, Katherine Lee, Adam Roberts, Barret Zoph, Denny Zhou, Jason Wei, Kevin Robinson, David Mimno, Daphne Ippolito
2024 A* conf
Adaptive Accompaniment with ReaLchords.
ICML
Yusong Wu, Tim Cooijmans, Kyle Kastner, Adam Roberts, Ian Simon, Alexander Scarlatos, Chris Donahue, Cassie Tarakajian, Shayegan Omidshafiei, Aaron C. Courville, Pablo Samuel Castro, Natasha Jaques, Cheng-Zhi Anna Huang
2024 J jnl
Scaling Instruction-Finetuned Language Models.
J. Mach. Learn. Res.
Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Alex Castro-Ros, Marie Pellat, Kevin Robinson, Dasha Valter, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Y. Zhao, Yanping Huang, Andrew M. Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei
2024 J jnl
Training LLMs over Neurally Compressed Text.
CoRR
Brian Lester, Jaehoon Lee, Alex Alemi, Jeffrey Pennington, Adam Roberts, Jascha Sohl-Dickstein, Noah Constant
2024 J jnl
Training LLMs over Neurally Compressed Text.
Trans. Mach. Learn. Res.
Brian Lester, Jaehoon Lee, Alexander A. Alemi, Jeffrey Pennington, Adam Roberts, Jascha Sohl-Dickstein, Noah Constant
2023 J jnl
A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity.
CoRR
Shayne Longpre, Gregory Yauney, Emily Reif, Katherine Lee, Adam Roberts, Barret Zoph, Denny Zhou, Jason Wei, Kevin Robinson, David Mimno, Daphne Ippolito
2023 — conf
Character-Aware Models Improve Visual Text Rendering.
ACL (1)
Rosanne Liu, Dan Garrette, Chitwan Saharia, William Chan, Adam Roberts, Sharan Narang, Irina Blok, RJ Mical, Mohammad Norouzi, Noah Constant
2023 — conf
Crosslingual Generalization through Multitask Finetuning.
ACL (1)
Niklas Muennighoff, Thomas Wang, Lintang Sutawika, Adam Roberts, Stella Biderman, Teven Le Scao, M. Saiful Bari, Sheng Shen, Zheng Xin Yong, Hailey Schoelkopf, Xiangru Tang, Dragomir Radev, Alham Fikri Aji, Khalid Almubarak, Samuel Albanie, Zaid Alyafeai, Albert Webson, Edward Raff, Colin Raffel
2023 A* conf
Large Language Models Struggle to Learn Long-Tail Knowledge.
ICML
Nikhil Kandpal, Haikang Deng, Adam Roberts, Eric Wallace, Colin Raffel
2023 J jnl
MusicLM: Generating Music From Text.
CoRR
Andrea Agostinelli, Timo I. Denk, Zalán Borsos, Jesse H. Engel, Mauro Verzetti, Antoine Caillon, Qingqing Huang, Aren Jansen, Adam Roberts, Marco Tagliasacchi, Matthew Sharifi, Neil Zeghidour, Christian Havnø Frank
2023 J jnl
PaLM: Scaling Language Modeling with Pathways.
J. Mach. Learn. Res.
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel
2023 J jnl
Report of the 1st Workshop on Generative AI and Law.
CoRR
A. Feder Cooper, Katherine Lee, James Grimmelmann, Daphne Ippolito, Christopher Callison-Burch, Christopher A. Choquette-Choo, Niloofar Mireshghallah, Miles Brundage, David Mimno, Madiha Zahrah Choksi, Jack M. Balkin, Nicholas Carlini, Christopher De Sa, Jonathan Frankle, Deep Ganguli, Bryant Gipson, Andres Guadamuz, Swee Leng Harris, Abigail Z. Jacobs, Elizabeth Joh, Gautam Kamath, Mark A. Lemley, Cass Matthews, Christine McLeavey, Corynne McSherry, Milad Nasr, Paul Ohm, Adam Roberts, Tom Rubin, Pamela Samuelson, Ludwig Schubert, Kristen Vaccaro, Luis Villa, Felix Wu, Elana Zeide
2023 J jnl
Scaling Up Models and Data with t5x and seqio.
J. Mach. Learn. Res.
Adam Roberts, Hyung Won Chung, Gaurav Mishra, Anselm Levskaya, James Bradbury, Daniel Andor, Sharan Narang, Brian Lester, Colin Gaffney, Afroz Mohiuddin, Curtis Hawthorne, Aitor Lewkowycz, Alex Salcianu, Marc van Zee, Jacob Austin, Sebastian Goodman, Livio Baldini Soares, Haitang Hu, Sasha Tsvyashchenko, Aakanksha Chowdhery, Jasmijn Bastings, Jannis Bulian, Xavier Garcia, Jianmo Ni, Andrew Chen, Kathleen Kenealy, Kehang Han, Michelle Casbon, Jonathan H. Clark, Stephan Lee, Dan Garrette, James Lee-Thorp, Colin Raffel, Noam Shazeer, Marvin Ritter, Maarten Bosma, Alexandre Passos, Jeremy Maitin-Shepard, Noah Fiedel, Mark Omernick, Brennan Saeta, Ryan Sepassi, Alexander Spiridonov, Joshua Newlan, Andrea Gesmundo
2023 J jnl
SingSong: Generating musical accompaniments from singing.
CoRR
Chris Donahue, Antoine Caillon, Adam Roberts, Ethan Manilow, Philippe Esling, Andrea Agostinelli, Mauro Verzetti, Ian Simon, Olivier Pietquin, Neil Zeghidour, Jesse H. Engel
2023 A* conf
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning.
ICML
Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V. Le, Barret Zoph, Jason Wei, Adam Roberts
2023 J jnl
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning.
CoRR
Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V. Le, Barret Zoph, Jason Wei, Adam Roberts
2023 A* conf
UniMax: Fairer and More Effective Language Sampling for Large-Scale Multilingual Pretraining.
ICLR
Hyung Won Chung, Xavier Garcia, Adam Roberts, Yi Tay, Orhan Firat, Sharan Narang, Noah Constant
2023 J jnl
UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretraining.
CoRR
Hyung Won Chung, Noah Constant, Xavier Garcia, Adam Roberts, Yi Tay, Sharan Narang, Orhan Firat
2022 J jnl
ByT5: Towards a Token-Free Future with Pre-trained Byte-to-Byte Models.
Trans. Assoc. Comput. Linguistics
Linting Xue, Aditya Barua, Noah Constant, Rami Al-Rfou, Sharan Narang, Mihir Kale, Adam Roberts, Colin Raffel
2022 J jnl
Character-Aware Models Improve Visual Text Rendering.
CoRR
Rosanne Liu, Dan Garrette, Chitwan Saharia, William Chan, Adam Roberts, Sharan Narang, Irina Blok, RJ Mical, Mohammad Norouzi, Noah Constant
2022 J jnl
Crosslingual Generalization through Multitask Finetuning.
CoRR
Niklas Muennighoff, Thomas Wang, Lintang Sutawika, Adam Roberts, Stella Biderman, Teven Le Scao, M. Saiful Bari, Sheng Shen, Zheng Xin Yong, Hailey Schoelkopf, Xiangru Tang, Dragomir Radev, Alham Fikri Aji, Khalid Almubarak, Samuel Albanie, Zaid Alyafeai, Albert Webson, Edward Raff, Colin Raffel
2022 J jnl
LaMDA: Language Models for Dialog Applications.
CoRR
Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, Yaguang Li, Hongrae Lee, Huaixiu Steven Zheng, Amin Ghafouri, Marcelo Menegali, Yanping Huang, Maxim Krikun, Dmitry Lepikhin, James Qin, Dehao Chen, Yuanzhong Xu, Zhifeng Chen, Adam Roberts, Maarten Bosma, Yanqi Zhou, Chung-Ching Chang, Igor Krivokon, Will Rusch, Marc Pickett, Kathleen S. Meier-Hellstern, Meredith Ringel Morris, Tulsee Doshi, Renelito Delos Santos, Toju Duke, Johnny Soraker, Ben Zevenbergen, Vinodkumar Prabhakaran, Mark Diaz, Ben Hutchinson, Kristen Olson, Alejandra Molina, Erin Hoffman-John, Josh Lee, Lora Aroyo, Ravi Rajakumar, Alena Butryna, Matthew Lamm, Viktoriya Kuzmina, Joe Fenton, Aaron Cohen, Rachel Bernstein, Ray Kurzweil, Blaise Agüera y Arcas, Claire Cui, Marian Croak, Ed H. Chi, Quoc Le
2022 J jnl
Large Language Models Struggle to Learn Long-Tail Knowledge.
CoRR
Nikhil Kandpal, Haikang Deng, Adam Roberts, Eric Wallace, Colin Raffel
2022 — conf
Multi-instrument Music Synthesis with Spectrogram Diffusion.
ISMIR
Curtis Hawthorne, Ian Simon, Adam Roberts, Neil Zeghidour, Josh Gardner, Ethan Manilow, Jesse H. Engel
2022 J jnl
Multi-instrument Music Synthesis with Spectrogram Diffusion.
CoRR
Curtis Hawthorne, Ian Simon, Adam Roberts, Neil Zeghidour, Josh Gardner, Ethan Manilow, Jesse H. Engel
2022 J jnl
PaLM: Scaling Language Modeling with Pathways.
CoRR
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel
2022 J jnl
Scaling Instruction-Finetuned Language Models.
CoRR
Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Eric Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Y. Zhao, Yanping Huang, Andrew M. Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei
2022 J jnl
Scaling Up Models and Data with t5x and seqio.
CoRR
Adam Roberts, Hyung Won Chung, Anselm Levskaya, Gaurav Mishra, James Bradbury, Daniel Andor, Sharan Narang, Brian Lester, Colin Gaffney, Afroz Mohiuddin, Curtis Hawthorne, Aitor Lewkowycz, Alex Salcianu, Marc van Zee, Jacob Austin, Sebastian Goodman, Livio Baldini Soares, Haitang Hu, Sasha Tsvyashchenko, Aakanksha Chowdhery, Jasmijn Bastings, Jannis Bulian, Xavier Garcia, Jianmo Ni, Andrew Chen, Kathleen Kenealy, Jonathan H. Clark, Stephan Lee, Dan Garrette, James Lee-Thorp, Colin Raffel, Noam Shazeer, Marvin Ritter, Maarten Bosma, Alexandre Passos, Jeremy Maitin-Shepard, Noah Fiedel, Mark Omernick, Brennan Saeta, Ryan Sepassi, Alexander Spiridonov, Joshua Newlan, Andrea Gesmundo
2022 J jnl
VeLO: Training Versatile Learned Optimizers by Scaling Up.
CoRR
Luke Metz, James Harrison, C. Daniel Freeman, Amil Merchant, Lucas Beyer, James Bradbury, Naman Agrawal, Ben Poole, Igor Mordatch, Adam Roberts, Jascha Sohl-Dickstein
2022 J jnl
What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?
CoRR
Thomas Wang, Adam Roberts, Daniel Hesslow, Teven Le Scao, Hyung Won Chung, Iz Beltagy, Julien Launay, Colin Raffel
2022 A* conf
What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization?
ICML
Thomas Wang, Adam Roberts, Daniel Hesslow, Teven Le Scao, Hyung Won Chung, Iz Beltagy, Julien Launay, Colin Raffel
2021 J jnl
ByT5: Towards a token-free future with pre-trained byte-to-byte models.
CoRR
Linting Xue, Aditya Barua, Noah Constant, Rami Al-Rfou, Sharan Narang, Mihir Kale, Adam Roberts, Colin Raffel
2021 — conf
Do Transformer Modifications Transfer Across Implementations and Applications?
EMNLP (1)
Sharan Narang, Hyung Won Chung, Yi Tay, Liam Fedus, Thibault Févry, Michael Matena, Karishma Malkan, Noah Fiedel, Noam Shazeer, Zhenzhong Lan, Yanqi Zhou, Wei Li, Nan Ding, Jake Marcus, Adam Roberts, Colin Raffel
2021 J jnl
Do Transformer Modifications Transfer Across Implementations and Applications?
CoRR
Sharan Narang, Hyung Won Chung, Yi Tay, William Fedus, Thibault Févry, Michael Matena, Karishma Malkan, Noah Fiedel, Noam Shazeer, Zhenzhong Lan, Yanqi Zhou, Wei Li, Nan Ding, Jake Marcus, Adam Roberts, Colin Raffel
2021 A* conf
Extracting Training Data from Large Language Models.
USENIX Security Symposium
Nicholas Carlini, Florian Tramèr, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom B. Brown, Dawn Song, Úlfar Erlingsson, Alina Oprea, Colin Raffel
2021 J jnl
NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned.
CoRR
Sewon Min, Jordan L. Boyd-Graber, Chris Alberti, Danqi Chen, Eunsol Choi, Michael Collins, Kelvin Guu, Hannaneh Hajishirzi, Kenton Lee, Jennimaria Palomaki, Colin Raffel, Adam Roberts, Tom Kwiatkowski, Patrick Lewis, Yuxiang Wu, Heinrich Küttler, Linqing Liu, Pasquale Minervini, Pontus Stenetorp, Sebastian Riedel, Sohee Yang, Minjoon Seo, Gautier Izacard, Fabio Petroni, Lucas Hosseini, Nicola De Cao, Edouard Grave, Ikuya Yamada, Sonse Shimaoka, Masatoshi Suzuki, Shumpei Miyawaki, Shun Sato, Ryo Takahashi, Jun Suzuki, Martin Fajcik, Martin Docekal, Karel Ondrej, Pavel Smrz, Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Barlas Oguz, Xilun Chen, Vladimir Karpukhin, Stan Peshterliev, Dmytro Okhonko, Michael Sejr Schlichtkrull, Sonal Gupta, Yashar Mehdad, Wen-tau Yih
2021 — conf
mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer.
NAACL-HLT
Linting Xue, Noah Constant, Adam Roberts, Mihir Kale, Rami Al-Rfou, Aditya Siddhant, Aditya Barua, Colin Raffel
2020 A* conf
DDSP: Differentiable Digital Signal Processing.
ICLR
Jesse H. Engel, Lamtharn Hantrakul, Chenjie Gu, Adam Roberts
2020 J jnl
DDSP: Differentiable Digital Signal Processing.
CoRR
Jesse H. Engel, Lamtharn Hantrakul, Chenjie Gu, Adam Roberts
2020 J jnl
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer.
J. Mach. Learn. Res.
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu
2020 J jnl
Extracting Training Data from Large Language Models.
CoRR
Nicholas Carlini, Florian Tramèr, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom B. Brown, Dawn Song, Úlfar Erlingsson, Alina Oprea, Colin Raffel
2020 — conf
How Much Knowledge Can You Pack Into the Parameters of a Language Model?
EMNLP (1)
Adam Roberts, Colin Raffel, Noam Shazeer
2020 J jnl
How Much Knowledge Can You Pack Into the Parameters of a Language Model?
CoRR
Adam Roberts, Colin Raffel, Noam Shazeer
2020 — conf
NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned.
NeurIPS (Competition and Demos)
Sewon Min, Jordan L. Boyd-Graber, Chris Alberti, Danqi Chen, Eunsol Choi, Michael Collins, Kelvin Guu, Hannaneh Hajishirzi, Kenton Lee, Jennimaria Palomaki, Colin Raffel, Adam Roberts, Tom Kwiatkowski, Patrick Lewis, Yuxiang Wu, Heinrich Küttler, Linqing Liu, Pasquale Minervini, Pontus Stenetorp, Sebastian Riedel, Sohee Yang, Minjoon Seo, Gautier Izacard, Fabio Petroni, Lucas Hosseini, Nicola De Cao, Edouard Grave, Ikuya Yamada, Sonse Shimaoka, Masatoshi Suzuki, Shumpei Miyawaki, Shun Sato, Ryo Takahashi, Jun Suzuki, Martin Fajcik, Martin Docekal, Karel Ondrej, Pavel Smrz, Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Barlas Oguz, Xilun Chen, Vladimir Karpukhin, Stan Peshterliev, Dmytro Okhonko, Michael Sejr Schlichtkrull, Sonal Gupta, Yashar Mehdad, Wen-tau Yih
2020 J jnl
WT5?! Training Text-to-Text Models to Explain their Predictions.
CoRR
Sharan Narang, Colin Raffel, Katherine Lee, Adam Roberts, Noah Fiedel, Karishma Malkan
2020 J jnl
mT5: A massively multilingual pre-trained text-to-text transformer.
CoRR
Linting Xue, Noah Constant, Adam Roberts, Mihir Kale, Rami Al-Rfou, Aditya Siddhant, Aditya Barua, Colin Raffel
2019 — conf
Approachable Music Composition with Machine Learning at Scale.
ISMIR
Cheng-Zhi Anna Huang, Curtis Hawthorne, Adam Roberts, Monica Dinculescu, James Wexler, Leon Hong, Jacob Howcroft
2019 J jnl
Counterpoint by Convolution.
CoRR
Cheng-Zhi Anna Huang, Tim Cooijmans, Adam Roberts, Aaron C. Courville, Douglas Eck
2019 — conf
Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset.
ICLR
Curtis Hawthorne, Andriy Stasyuk, Adam Roberts, Ian Simon, Cheng-Zhi Anna Huang, Sander Dieleman, Erich Elsen, Jesse H. Engel, Douglas Eck
2019 J jnl
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer.
CoRR
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J. Liu
2019 — conf
Fast and Flexible Neural Audio Synthesis.
ISMIR
Lamtharn Hantrakul, Jesse H. Engel, Adam Roberts, Chenjie Gu
2019 — conf
GANSynth: Adversarial Neural Audio Synthesis.
ICLR (Poster)
Jesse H. Engel, Kumar Krishna Agrawal, Shuo Chen, Ishaan Gulrajani, Chris Donahue, Adam Roberts
2019 J jnl
GANSynth: Adversarial Neural Audio Synthesis.
CoRR
Jesse H. Engel, Kumar Krishna Agrawal, Shuo Chen, Ishaan Gulrajani, Chris Donahue, Adam Roberts
2019 — conf
Identifying the Intersections: User Experience + Research Scientist Collaboration in a Generative Machine Learning Interface.
CHI Extended Abstracts
Claire Kayacik, Sherol Chen, Signe Noerly, Jess Holbrook, Adam Roberts, Douglas Eck
2019 A* conf
Learning to Groove with Inverse Sequence Transformations.
ICML
Jon Gillick, Adam Roberts, Jesse H. Engel, Douglas Eck, David Bamman
2019 J jnl
Learning to Groove with Inverse Sequence Transformations.
CoRR
Jon Gillick, Adam Roberts, Jesse H. Engel, Douglas Eck, David Bamman
2019 J jnl
The Bach Doodle: Approachable music composition with machine learning at scale.
CoRR
Cheng-Zhi Anna Huang, Curtis Hawthorne, Adam Roberts, Monica Dinculescu, James Wexler, Leon Hong, Jacob Howcroft
2018 A* conf
A Hierarchical Latent Vector Model for Learning Long-Term Structure in Music.
ICML
Adam Roberts, Jesse H. Engel, Colin Raffel, Curtis Hawthorne, Douglas Eck
2018 J jnl
A Hierarchical Latent Vector Model for Learning Long-Term Structure in Music.
CoRR
Adam Roberts, Jesse H. Engel, Colin Raffel, Curtis Hawthorne, Douglas Eck
2018 J jnl
Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset.
CoRR
Curtis Hawthorne, Andriy Stasyuk, Adam Roberts, Ian Simon, Cheng-Zhi Anna Huang, Sander Dieleman, Erich Elsen, Jesse H. Engel, Douglas Eck
2018 — conf
Latent Constraints: Learning to Generate Conditionally from Unconditional Generative Models.
ICLR (Poster)
Jesse H. Engel, Matthew D. Hoffman, Adam Roberts
2018 — conf
Learning Latent Representations of Music to Generate Interactive Musical Palettes.
IUI Workshops
Adam Roberts, Jesse H. Engel, Sageev Oore, Douglas Eck
2018 J jnl
Learning a Latent Space of Multitrack Measures.
CoRR
Ian Simon, Adam Roberts, Colin Raffel, Jesse H. Engel, Curtis Hawthorne, Douglas Eck
2018 — conf
Onsets and Frames: Dual-Objective Piano Transcription.
ISMIR
Curtis Hawthorne, Erich Elsen, Jialin Song, Adam Roberts, Ian Simon, Colin Raffel, Jesse H. Engel, Sageev Oore, Douglas Eck
2017 — conf
Counterpoint by Convolution.
ISMIR
Cheng-Zhi Anna Huang, Tim Cooijmans, Adam Roberts, Aaron C. Courville, Douglas Eck
2017 J jnl
Latent Constraints: Learning to Generate Conditionally from Unconditional Generative Models.
CoRR
Jesse H. Engel, Matthew D. Hoffman, Adam Roberts
2017 A* conf
Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders.
ICML
Jesse H. Engel, Cinjon Resnick, Adam Roberts, Sander Dieleman, Mohammad Norouzi, Douglas Eck, Karen Simonyan
2017 J jnl
Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders.
CoRR
Jesse H. Engel, Cinjon Resnick, Adam Roberts, Sander Dieleman, Douglas Eck, Karen Simonyan, Mohammad Norouzi
2017 J jnl
Onsets and Frames: Dual-Objective Piano Transcription.
CoRR
Curtis Hawthorne, Erich Elsen, Jialin Song, Adam Roberts, Ian Simon, Colin Raffel, Jesse H. Engel, Sageev Oore, Douglas Eck
2015 — conf
Perception and representation of Bengali nasal vowels.
ICPhS
Sandra Kotzor, Adam Roberts, Allison Wetterlin, Aditi Lahiri
2013 — —
Ambiguous fragment assignment for high-throughput sequencing experiments.
Adam Roberts
2013 J jnl
Fragment assignment in the cloud with eXpress-D.
BMC Bioinform.
Adam Roberts, Harvey Feng, Lior Pachter
2013 J jnl
Updating RNA-Seq analyses after re-annotation.
Bioinform.
Adam Roberts, Lorian Schaeffer, Lior Pachter
2012 J jnl
Quantifying uniformity of mapped reads.
Bioinform.
Valerie Hower, Richard Starfield, Adam Roberts, Lior Pachter
2011 J jnl
Identification of novel transcripts in annotated genomes using RNA-Seq.
Bioinform.
Adam Roberts, Harold Pimentel, Cole Trapnell, Lior Pachter
2009 — conf
Automated Risk Detection - What are the Key Elements Needed to Create a Multi-source, Pattern-based Risk Detection System?
HEALTHINF
Ian Blunt, Xavier Chitnis, Adam Roberts
2009 J jnl
Fast Statistical Alignment.
PLoS Comput. Biol.
Robert K. Bradley, Adam Roberts, Michael E. Smoot, Sudeep Juvekar, Jaeyoung Do, Colin N. Dewey, Ian H. Holmes, Lior Pachter
2007 — conf
Inferring missing genotypes in large SNP panels using fast nearest-neighbor searches over sliding windows.
ISMB/ECCB (Supplement of Bioinformatics)
Adam Roberts, Leonard McMillan, Wei Wang, Joel Parker, Ivan Rusyn, David Threadgill
2007 A* conf
Sample Selection for Maximal Diversity.
ICDM
Feng Pan, Adam Roberts, Leonard McMillan, David Threadgill, Wei Wang