Jacob Devlin

53 papers A* 5B 3C 1Journal 26Unranked 18
YearRankTypeTitle / Venue / Authors
2024 J jnl
Scaling Instruction-Finetuned Language Models.
J. Mach. Learn. Res.
Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Alex Castro-Ros, Marie Pellat, Kevin Robinson, Dasha Valter, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Y. Zhao, Yanping Huang, Andrew M. Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei
2023 — conf
Efficiently Scaling Transformer Inference.
MLSys
Reiner Pope, Sholto Douglas, Aakanksha Chowdhery, Jacob Devlin, James Bradbury, Jonathan Heek, Kefan Xiao, Shivani Agrawal, Jeff Dean
2023 J jnl
PaLM 2 Technical Report.
CoRR
Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, Eric Chu, Jonathan H. Clark, Laurent El Shafey, Yanping Huang, Kathy Meier-Hellstern, Gaurav Mishra, Erica Moreira, Mark Omernick, Kevin Robinson, Sebastian Ruder, Yi Tay, Kefan Xiao, Yuanzhong Xu, Yujing Zhang, Gustavo Hernández Ábrego, Junwhan Ahn, Jacob Austin, Paul Barham, Jan A. Botha, James Bradbury, Siddhartha Brahma, Kevin Brooks, Michele Catasta, Yong Cheng, Colin Cherry, Christopher A. Choquette-Choo, Aakanksha Chowdhery, Clément Crepy, Shachi Dave, Mostafa Dehghani, Sunipa Dev, Jacob Devlin, Mark Díaz, Nan Du, Ethan Dyer, Vladimir Feinberg, Fangxiaoyu Feng, Vlad Fienber, Markus Freitag, Xavier Garcia, Sebastian Gehrmann, Lucas Gonzalez, et al.
2023 J jnl
PaLM: Scaling Language Modeling with Pathways.
J. Mach. Learn. Res.
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel
2023 — conf
QueryForm: A Simple Zero-shot Form Entity Query Framework.
ACL (Findings)
Zifeng Wang, Zizhao Zhang, Jacob Devlin, Chen-Yu Lee, Guolong Su, Hao Zhang, Jennifer G. Dy, Vincent Perot, Tomas Pfister
2022 J jnl
Efficiently Scaling Transformer Inference.
CoRR
Reiner Pope, Sholto Douglas, Aakanksha Chowdhery, Jacob Devlin, James Bradbury, Anselm Levskaya, Jonathan Heek, Kefan Xiao, Shivani Agrawal, Jeff Dean
2022 J jnl
PaLM: Scaling Language Modeling with Pathways.
CoRR
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel
2022 J jnl
QueryForm: A Simple Zero-shot Form Entity Query Framework.
CoRR
Zifeng Wang, Zizhao Zhang, Jacob Devlin, Chen-Yu Lee, Guolong Su, Hao Zhang, Jennifer G. Dy, Vincent Perot, Tomas Pfister
2022 J jnl
Scaling Instruction-Finetuned Language Models.
CoRR
Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Eric Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Y. Zhao, Yanping Huang, Andrew M. Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei
2021 — conf
Multi-Vector Attention Models for Deep Re-ranking.
EMNLP (1)
Giulio Zhou, Jacob Devlin
2019 — conf
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding.
NAACL-HLT (1)
Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
2019 J jnl
Language Model Pre-training for Hierarchical Document Representations.
CoRR
Ming-Wei Chang, Kristina Toutanova, Kenton Lee, Jacob Devlin
2019 J jnl
Natural Questions: a Benchmark for Question Answering Research.
Trans. Assoc. Comput. Linguistics
Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur P. Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, Kristina Toutanova, Llion Jones, Matthew Kelcey, Ming-Wei Chang, Andrew M. Dai, Jakob Uszkoreit, Quoc Le, Slav Petrov
2019 — conf
Synthetic QA Corpora Generation with Roundtrip Consistency.
ACL (1)
Chris Alberti, Daniel Andor, Emily Pitler, Jacob Devlin, Michael Collins
2019 J jnl
Synthetic QA Corpora Generation with Roundtrip Consistency.
CoRR
Chris Alberti, Daniel Andor, Emily Pitler, Jacob Devlin, Michael Collins
2019 — conf
Zero-Shot Entity Linking by Reading Entity Descriptions.
ACL (1)
Lajanugen Logeswaran, Ming-Wei Chang, Kenton Lee, Kristina Toutanova, Jacob Devlin, Honglak Lee
2019 J jnl
Zero-Shot Entity Linking by Reading Entity Descriptions.
CoRR
Lajanugen Logeswaran, Ming-Wei Chang, Kenton Lee, Kristina Toutanova, Jacob Devlin, Honglak Lee
2018 J jnl
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding.
CoRR
Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
2018 — conf
Leveraging Grammar and Reinforcement Learning for Neural Program Synthesis.
ICLR (Poster)
Rudy Bunel, Matthew J. Hausknecht, Jacob Devlin, Rishabh Singh, Pushmeet Kohli
2018 J jnl
Leveraging Grammar and Reinforcement Learning for Neural Program Synthesis.
CoRR
Rudy Bunel, Matthew J. Hausknecht, Jacob Devlin, Rishabh Singh, Pushmeet Kohli
2018 — conf
Universal Neural Machine Translation for Extremely Low Resource Languages.
NAACL-HLT
Jiatao Gu, Hany Hassan, Jacob Devlin, Victor O. K. Li
2018 J jnl
Universal Neural Machine Translation for Extremely Low Resource Languages.
CoRR
Jiatao Gu, Hany Hassan, Jacob Devlin, Victor O. K. Li
2017 — conf
Neural Program Meta-Induction.
NIPS
Jacob Devlin, Rudy Bunel, Rishabh Singh, Matthew J. Hausknecht, Pushmeet Kohli
2017 J jnl
Neural Program Meta-Induction.
CoRR
Jacob Devlin, Rudy Bunel, Rishabh Singh, Matthew J. Hausknecht, Pushmeet Kohli
2017 A* conf
RobustFill: Neural Program Learning under Noisy I/O.
ICML
Jacob Devlin, Jonathan Uesato, Surya Bhupatiraju, Rishabh Singh, Abdel-rahman Mohamed, Pushmeet Kohli
2017 J jnl
RobustFill: Neural Program Learning under Noisy I/O.
CoRR
Jacob Devlin, Jonathan Uesato, Surya Bhupatiraju, Rishabh Singh, Abdel-rahman Mohamed, Pushmeet Kohli
2017 J jnl
Semantic Code Repair using Neuro-Symbolic Transformation Networks.
CoRR
Jacob Devlin, Jonathan Uesato, Rishabh Singh, Pushmeet Kohli
2017 A* conf
Sharp Models on Dull Hardware: Fast and Accurate Neural Machine Translation Decoding on the CPU.
EMNLP
Jacob Devlin
2017 J jnl
Sharp Models on Dull Hardware: Fast and Accurate Neural Machine Translation Decoding on the CPU.
CoRR
Jacob Devlin
2016 — conf
Generating Natural Questions About an Image.
ACL (1)
Nasrin Mostafazadeh, Ishan Misra, Jacob Devlin, Margaret Mitchell, Xiaodong He, Lucy Vanderwende
2016 J jnl
Generating Natural Questions About an Image.
CoRR
Nasrin Mostafazadeh, Ishan Misra, Jacob Devlin, Larry Zitnick, Margaret Mitchell, Xiaodong He, Lucy Vanderwende
2016 — conf
Visual Storytelling.
HLT-NAACL
Ting-Hao (Kenneth) Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross B. Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Lucy Vanderwende, Michel Galley, Margaret Mitchell
2016 J jnl
Visual Storytelling.
CoRR
Ting-Hao (Kenneth) Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross B. Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Lucy Vanderwende, Michel Galley, Margaret Mitchell
2015 A* conf
A Survey of Current Datasets for Vision and Language Research.
EMNLP
Francis Ferraro, Nasrin Mostafazadeh, Ting-Hao (Kenneth) Huang, Lucy Vanderwende, Jacob Devlin, Michel Galley, Margaret Mitchell
2015 J jnl
Detecting Interrogative Utterances with Recurrent Neural Networks.
CoRR
Junyoung Chung, Jacob Devlin, Hany Hassan Awadalla
2015 J jnl
Exploring Nearest Neighbor Approaches for Image Captioning.
CoRR
Jacob Devlin, Saurabh Gupta, Ross B. Girshick, Margaret Mitchell, C. Lawrence Zitnick
2015 — conf
Language Models for Image Captioning: The Quirks and What Works.
ACL (2)
Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell
2015 J jnl
Language Models for Image Captioning: The Quirks and What Works.
CoRR
Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell
2015 J jnl
On Available Corpora for Empirical Methods in Vision & Language.
CoRR
Francis Ferraro, Nasrin Mostafazadeh, Ting-Hao (Kenneth) Huang, Lucy Vanderwende, Jacob Devlin, Michel Galley, Margaret Mitchell
2015 A* conf
Pre-Computable Multi-Layer Neural Network Language Models.
EMNLP
Jacob Devlin, Chris Quirk, Arul Menezes
2015 — conf
Statistical Machine Translation Features with Multitask Tensor Networks.
ACL (1)
Hendra Setiawan, Zhongqiang Huang, Jacob Devlin, Thomas Lamar, Rabih Zbib, Richard M. Schwartz, John Makhoul
2015 J jnl
Statistical Machine Translation Features with Multitask Tensor Networks.
CoRR
Hendra Setiawan, Zhongqiang Huang, Jacob Devlin, Thomas Lamar, Rabih Zbib, Richard M. Schwartz, John Makhoul
2014 — conf
Fast and Robust Neural Network Joint Models for Statistical Machine Translation.
ACL (1)
Jacob Devlin, Rabih Zbib, Zhongqiang Huang, Thomas Lamar, Richard M. Schwartz, John Makhoul
2013 J jnl
BBN TransTalk: Robust multilingual two-way speech-to-speech translation for mobile platforms.
Comput. Speech Lang.
Rohit Prasad, Prem Natarajan, David Stallard, Shirin Saleem, Shankar Ananthakrishnan, Stavros Tsakalidis, Chia-Lin Kao, Fred Choi, Ralf Meermeier, Mark Rawls, Jacob Devlin, Kriste Krstovski, Aaron Challenner
2013 — conf
BBN's Systems for the Chinese-English Sub-task of the NTCIR-10 PatentMT Evaluation.
NTCIR
Zhongqiang Huang, Jacob Devlin, Spyros Matsoukas
2013 A* conf
Factored Soft Source Syntactic Constraints for Hierarchical Machine Translation.
EMNLP
Zhongqiang Huang, Jacob Devlin, Rabih Zbib
2012 C conf
Automatic Tune Set Generation for Machine Translation with Limited Indomain Data.
EAMT
Jinying Chen, Jacob Devlin, Huaigu Cao, Rohit Prasad, Premkumar Natarajan
2012 B conf
Document recognition and translation system for unconstrained Arabic documents.
ICPR
Huaigu Cao, Jinying Chen, Jacob Devlin, Rohit Prasad, Prem Natarajan
2012 — conf
Machine Translation of Arabic Dialects.
HLT-NAACL
Rabih Zbib, Erika Malchiodi, Jacob Devlin, David Stallard, Spyros Matsoukas, Richard M. Schwartz, John Makhoul, Omar Zaidan, Chris Callison-Burch
2012 B conf
Statistical Machine Translation as a Language Model for Handwriting Recognition.
ICFHR
Jacob Devlin, Matin Kamali, Krishna Subramanian, Rohit Prasad, Prem Natarajan
2012 — conf
Trait-Based Hypothesis Selection For Machine Translation.
HLT-NAACL
Jacob Devlin, Spyros Matsoukas
2012 — conf
Unsupervised Morphology Rivals Supervised Morphology for Arabic MT.
ACL (2)
David Stallard, Jacob Devlin, Michael Kayser, Yoong Keok Lee, Regina Barzilay
2011 B conf
System Combination Using Discriminative Cross-Adaptation.
IJCNLP
Jacob Devlin, Antti-Veikko I. Rosti, Sankaranarayanan Ananthakrishnan, Spyros Matsoukas