Melvin Johnson

55 papers A* 5A 2Misc 1Journal 35Unranked 12

Year	Rank	Type	Title / Venue / Authors
2024	J	`jnl`	Capabilities of Gemini Models in Medicine. CoRR Khaled Saab, Tao Tu, Wei-Hung Weng, Ryutaro Tanno, David Stutz, Ellery Wulczyn, Fan Zhang, Tim Strother, Chunjong Park, Elahe Vedadi, Juanma Zambrano Chaves, Szu-Yeu Hu, Mike Schaekermann, Aishwarya Kamath, Yong Cheng, David G. T. Barrett, Cathy Cheung, Basil Mustafa, Anil Palepu, Daniel McDuff, Le Hou, Tomer Golany, Luyang Liu, Jean-Baptiste Alayrac, Neil Houlsby, Nenad Tomasev, Jan Freyberg, Charles Lau, Jonas Kemp, Jeremy Lai, Shekoofeh Azizi, Kimberly Kanada, SiWai Man, Kavita Kulkarni, Ruoxi Sun, Siamak Shakeri, Luheng He, Benjamin Caine, Albert Webson, Natasha Latysheva, Melvin Johnson, Philip Andrew Mansfield, Jian Lu, Ehud Rivlin, Jesper Anderson, Bradley Green, Renee Wong, Jonathan Krause, Jonathon Shlens, Ewa Dominowska, S. M. Ali Eslami, Katherine Chou, Claire Cui, Oriol Vinyals, Koray Kavukcuoglu, James Manyika, Jeff Dean, Demis Hassabis, Yossi Matias, Dale R. Webster, Joelle K. Barral, Greg Corrado, Christopher Semturs, S. Sara Mahdavi, Juraj Gottweis, Alan Karthikesalingam, Vivek Natarajan
2024	J	`jnl`	Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context. CoRR Machel Reid, Nikolay Savinov, Denis Teplyashin, Dmitry Lepikhin, Timothy P. Lillicrap, Jean-Baptiste Alayrac, Radu Soricut, Angeliki Lazaridou, Orhan Firat, Julian Schrittwieser, Ioannis Antonoglou, Rohan Anil, Sebastian Borgeaud, Andrew M. Dai, Katie Millican, Ethan Dyer, Mia Glaese, Thibault Sottiaux, Benjamin Lee, Fabio Viola, Malcolm Reynolds, Yuanzhong Xu, James Molloy, Jilin Chen, Michael Isard, Paul Barham, Tom Hennigan, Ross McIlroy, Melvin Johnson, Johan Schalkwyk, Eli Collins, Eliza Rutherford, Erica Moreira, Kareem Ayoub, Megha Goel, Clemens Meyer, Gregory Thornton, Zhen Yang, Henryk Michalewski, Zaheer Abbas, Nathan Schucher, Ankesh Anand, Richard Ives, James Keeling, Karel Lenc, Salem Haykal, Siamak Shakeri, Pranav Shyam, Aakanksha Chowdhery, Roman Ring, Stephen Spencer, Eren Sezener, et al.
2023	A*	`conf`	Mu ICML Yong Cheng, Yu Zhang, Melvin Johnson, Wolfgang Macherey, Ankur Bapna
2023	J	`jnl`	PaLM 2 Technical Report. CoRR Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, Eric Chu, Jonathan H. Clark, Laurent El Shafey, Yanping Huang, Kathy Meier-Hellstern, Gaurav Mishra, Erica Moreira, Mark Omernick, Kevin Robinson, Sebastian Ruder, Yi Tay, Kefan Xiao, Yuanzhong Xu, Yujing Zhang, Gustavo Hernández Ábrego, Junwhan Ahn, Jacob Austin, Paul Barham, Jan A. Botha, James Bradbury, Siddhartha Brahma, Kevin Brooks, Michele Catasta, Yong Cheng, Colin Cherry, Christopher A. Choquette-Choo, Aakanksha Chowdhery, Clément Crepy, Shachi Dave, Mostafa Dehghani, Sunipa Dev, Jacob Devlin, Mark Díaz, Nan Du, Ethan Dyer, Vladimir Feinberg, Fangxiaoyu Feng, Vlad Fienber, Markus Freitag, Xavier Garcia, Sebastian Gehrmann, Lucas Gonzalez, et al.
2023	A*	`conf`	The Unreasonable Effectiveness of Few-shot Learning for Machine Translation. ICML Xavier Garcia, Yamini Bansal, Colin Cherry, George F. Foster, Maxim Krikun, Melvin Johnson, Orhan Firat
2023	J	`jnl`	The unreasonable effectiveness of few-shot learning for machine translation. CoRR Xavier Garcia, Yamini Bansal, Colin Cherry, George F. Foster, Maxim Krikun, Fangxiaoyu Feng, Melvin Johnson, Orhan Firat
2023	—	`conf`	XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages. EMNLP (Findings) Sebastian Ruder, Jonathan H. Clark, Alexander Gutkin, Mihir Kale, Min Ma, Massimo Nicosia, Shruti Rijhwani, Parker Riley, Jean Michel A. Sarr, Xinyi Wang, John Wieting, Nitish Gupta, Anna Katanova, Christo Kirov, Dana L. Dickinson, Brian Roark, Bidisha Samanta, Connie Tao, David Ifeoluwa Adelani, Vera Axelrod, Isaac Caswell, Colin Cherry, Dan Garrette, R. Reeve Ingle, Melvin Johnson, Dmitry Panteleev, Partha Talukdar
2023	J	`jnl`	XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages. CoRR Sebastian Ruder, Jonathan H. Clark, Alexander Gutkin, Mihir Kale, Min Ma, Massimo Nicosia, Shruti Rijhwani, Parker Riley, Jean Michel A. Sarr, Xinyi Wang, John Wieting, Nitish Gupta, Anna Katanova, Christo Kirov, Dana L. Dickinson, Brian Roark, Bidisha Samanta, Connie Tao, David Ifeoluwa Adelani, Vera Axelrod, Isaac Caswell, Colin Cherry, Dan Garrette, R. Reeve Ingle, Melvin Johnson, Dmitry Panteleev, Partha Talukdar
2022	—	`conf`	DOCmT5: Document-Level Pretraining of Multilingual Language Models. NAACL-HLT (Findings) Chia-Hsuan Lee, Aditya Siddhant, Viresh Ratnakar, Melvin Johnson
2022	—	`conf`	Domain Curricula for Code-Switched MT at MixMT 2022. WMT Lekan Raheem, Maab Elrashid, Melvin Johnson, Julia Kreutzer
2022	J	`jnl`	Mu CoRR Yong Cheng, Yu Zhang, Melvin Johnson, Wolfgang Macherey, Ankur Bapna
2022	—	`conf`	Multilingual Document-Level Translation Enables Zero-Shot Transfer From Sentences to Documents. ACL (1) Biao Zhang, Ankur Bapna, Melvin Johnson, Ali Dabirmoghaddam, Naveen Arivazhagan, Orhan Firat
2022	A	`conf`	XTREME-S: Evaluating Cross-lingual Speech Representations. INTERSPEECH Alexis Conneau, Ankur Bapna, Yu Zhang, Min Ma, Patrick von Platen, Anton Lozhkov, Colin Cherry, Ye Jia, Clara Rivera, Mihir Kale, Daan van Esch, Vera Axelrod, Simran Khanuja, Jonathan H. Clark, Orhan Firat, Michael Auli, Sebastian Ruder, Jason Riesa, Melvin Johnson
2022	J	`jnl`	XTREME-S: Evaluating Cross-lingual Speech Representations. CoRR Alexis Conneau, Ankur Bapna, Yu Zhang, Min Ma, Patrick von Platen, Anton Lozhkov, Colin Cherry, Ye Jia, Clara Rivera, Mihir Kale, Daan van Esch, Vera Axelrod, Simran Khanuja, Jonathan H. Clark, Orhan Firat, Michael Auli, Sebastian Ruder, Jason Riesa, Melvin Johnson
2022	J	`jnl`	mSLAM: Massively multilingual joint pre-training for speech and text. CoRR Ankur Bapna, Colin Cherry, Yu Zhang, Ye Jia, Melvin Johnson, Yong Cheng, Simran Khanuja, Jason Riesa, Alexis Conneau
2021	J	`jnl`	DOCmT5: Document-Level Pretraining of Multilingual Language Models. CoRR Chia-Hsuan Lee, Aditya Siddhant, Viresh Ratnakar, Melvin Johnson
2021	J	`jnl`	Distilling Large Language Models into Tiny and Effective Students using pQRNN. CoRR Prabhu Kaliamoorthi, Aditya Siddhant, Edward Li, Melvin Johnson
2021	—	`conf`	Explicit Alignment Objectives for Multilingual Bidirectional Encoders. NAACL-HLT Junjie Hu, Melvin Johnson, Orhan Firat, Aditya Siddhant, Graham Neubig
2021	J	`jnl`	Gradient-guided Loss Masking for Neural Machine Translation. CoRR Xinyi Wang, Ankur Bapna, Melvin Johnson, Orhan Firat
2021	—	`conf`	HintedBT: Augmenting Back-Translation with Quality and Transliteration Hints. EMNLP (1) Sahana Ramnath, Melvin Johnson, Abhirut Gupta, Aravindan Raghuveer
2021	J	`jnl`	HintedBT: Augmenting Back-Translation with Quality and Transliteration Hints. CoRR Sahana Ramnath, Melvin Johnson, Abhirut Gupta, Aravindan Raghuveer
2021	—	`conf`	MergeDistill: Merging Language Models using Pre-trained Distillation. ACL/IJCNLP (Findings) Simran Khanuja, Melvin Johnson, Partha P. Talukdar
2021	J	`jnl`	MergeDistill: Merging Pre-trained Language Models using Distillation. CoRR Simran Khanuja, Melvin Johnson, Partha P. Talukdar
2021	J	`jnl`	Multilingual Document-Level Translation Enables Zero-Shot Transfer From Sentences to Documents. CoRR Biao Zhang, Ankur Bapna, Melvin Johnson, Ali Dabirmoghaddam, Naveen Arivazhagan, Orhan Firat
2021	A*	`conf`	Rethinking Embedding Coupling in Pre-trained Language Models. ICLR Hyung Won Chung, Thibault Févry, Henry Tsai, Melvin Johnson, Sebastian Ruder
2021	J	`jnl`	SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training. CoRR Ankur Bapna, Yu-An Chung, Nan Wu, Anmol Gulati, Ye Jia, Jonathan H. Clark, Melvin Johnson, Jason Riesa, Alexis Conneau, Yu Zhang
2021	J	`jnl`	They, Them, Theirs: Rewriting with Gender-Neutral English. CoRR Tony Sun, Kellie Webster, Apurva Shah, William Yang Wang, Melvin Johnson
2021	—	`conf`	XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation. EMNLP (1) Sebastian Ruder, Noah Constant, Jan A. Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Dan Garrette, Graham Neubig, Melvin Johnson
2021	J	`jnl`	XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation. CoRR Sebastian Ruder, Noah Constant, Jan A. Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Graham Neubig, Melvin Johnson
2021	—	`conf`	nmT5 - Is parallel data still relevant for pre-training massively multilingual language models? ACL/IJCNLP (2) Mihir Kale, Aditya Siddhant, Rami Al-Rfou, Linting Xue, Noah Constant, Melvin Johnson
2021	J	`jnl`	nmT5 - Is parallel data still relevant for pre-training massively multilingual language models? CoRR Mihir Kale, Aditya Siddhant, Noah Constant, Melvin Johnson, Rami Al-Rfou, Linting Xue
2020	A*	`conf`	Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation. AAAI Aditya Siddhant, Melvin Johnson, Henry Tsai, Naveen Ari, Jason Riesa, Ankur Bapna, Orhan Firat, Karthik Raman
2020	J	`jnl`	Explicit Alignment Objectives for Multilingual Bidirectional Encoders. CoRR Junjie Hu, Melvin Johnson, Orhan Firat, Aditya Siddhant, Graham Neubig
2020	J	`jnl`	Rethinking embedding coupling in pre-trained language models. CoRR Hyung Won Chung, Thibault Févry, Henry Tsai, Melvin Johnson, Sebastian Ruder
2020	A*	`conf`	XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation. ICML Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, Melvin Johnson
2020	J	`jnl`	XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization. CoRR Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, Melvin Johnson
2019	J	`jnl`	Adaptive Scheduling for Multi-Task Learning. CoRR Sébastien Jean, Orhan Firat, Melvin Johnson
2019	A	`conf`	Direct Speech-to-Speech Translation with a Sequence-to-Sequence Model. INTERSPEECH Ye Jia, Ron J. Weiss, Fadi Biadsy, Wolfgang Macherey, Melvin Johnson, Zhifeng Chen, Yonghui Wu
2019	J	`jnl`	Direct speech-to-speech translation with a sequence-to-sequence model. CoRR Ye Jia, Ron J. Weiss, Fadi Biadsy, Wolfgang Macherey, Melvin Johnson, Zhifeng Chen, Yonghui Wu
2019	J	`jnl`	Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation. CoRR Aditya Siddhant, Melvin Johnson, Henry Tsai, Naveen Arivazhagan, Jason Riesa, Ankur Bapna, Orhan Firat, Karthik Raman
2019	Misc	`conf`	Leveraging Weakly Supervised Data to Improve End-to-end Speech-to-text Translation. ICASSP Ye Jia, Melvin Johnson, Wolfgang Macherey, Ron J. Weiss, Yuan Cao, Chung-Cheng Chiu, Naveen Ari, Stella Laurenzo, Yonghui Wu
2019	J	`jnl`	Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling. CoRR Jonathan Shen, Patrick Nguyen, Yonghui Wu, Zhifeng Chen, Mia Xu Chen, Ye Jia, Anjuli Kannan, Tara N. Sainath, Yuan Cao, Chung-Cheng Chiu, Yanzhang He, Jan Chorowski, Smit Hinsu, Stella Laurenzo, James Qin, Orhan Firat, Wolfgang Macherey, Suyog Gupta, Ankur Bapna, Shuyuan Zhang, Ruoming Pang, Ron J. Weiss, Rohit Prabhavalkar, Qiao Liang, Benoit Jacob, Bowen Liang, HyoukJoong Lee, Ciprian Chelba, Sébastien Jean, Bo Li, Melvin Johnson, Rohan Anil, Rajat Tibrewal, Xiaobing Liu, Akiko Eriguchi, Navdeep Jaitly, Naveen Ari, Colin Cherry, Parisa Haghani, Otavio Good, Youlong Cheng, Raziel Alvarez, Isaac Caswell, Wei-Ning Hsu, Zongheng Yang, Kuan-Chieh Wang, Ekaterina Gonina, Katrin Tomanek, Ben Vanik, Zelin Wu, Llion Jones, Mike Schuster, Yanping Huang, Dehao Chen, Kazuki Irie, George F. Foster, John Richardson, Klaus Macherey, Antoine Bruguier, Heiga Zen, Colin Raffel, Shankar Kumar, Kanishka Rao, David Rybach, Matthew Murray, Vijayaditya Peddinti, Maxim Krikun, Michiel Bacchiani, Thomas B. Jablin, Robert Suderman, Ian Williams, Benjamin Lee, Deepti Bhatia, Justin Carlson, Semih Yavuz, Yu Zhang, Ian McGraw, Max Galkin, Qi Ge, Golan Pundak, Chad Whipkey, Todd Wang, Uri Alon, Dmitry Lepikhin, Ye Tian, Sara Sabour, William Chan, Shubham Toshniwal, Baohua Liao, Michael Nirschl, Pat Rondon
2019	J	`jnl`	Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges. CoRR Naveen Arivazhagan, Ankur Bapna, Orhan Firat, Dmitry Lepikhin, Melvin Johnson, Maxim Krikun, Mia Xu Chen, Yuan Cao, George F. Foster, Colin Cherry, Wolfgang Macherey, Zhifeng Chen, Yonghui Wu
2019	—	`conf`	Massively Multilingual Neural Machine Translation. NAACL-HLT (1) Roee Aharoni, Melvin Johnson, Orhan Firat
2019	J	`jnl`	Massively Multilingual Neural Machine Translation. CoRR Roee Aharoni, Melvin Johnson, Orhan Firat
2019	—	`conf`	Small and Practical BERT Models for Sequence Labeling. EMNLP/IJCNLP (1) Henry Tsai, Jason Riesa, Melvin Johnson, Naveen Arivazhagan, Xin Li, Amelia Archer
2019	J	`jnl`	Small and Practical BERT Models for Sequence Labeling. CoRR Henry Tsai, Jason Riesa, Melvin Johnson, Naveen Arivazhagan, Xin Li, Amelia Archer
2019	J	`jnl`	The Missing Ingredient in Zero-Shot Neural Machine Translation. CoRR Naveen Arivazhagan, Ankur Bapna, Orhan Firat, Roee Aharoni, Melvin Johnson, Wolfgang Macherey
2018	J	`jnl`	Leveraging Weakly Supervised Data to Improve End-to-End Speech-to-Text Translation. CoRR Ye Jia, Melvin Johnson, Wolfgang Macherey, Ron J. Weiss, Yuan Cao, Chung-Cheng Chiu, Naveen Ari, Stella Laurenzo, Yonghui Wu
2018	—	`conf`	The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. ACL (1) Mia Xu Chen, Orhan Firat, Ankur Bapna, Melvin Johnson, Wolfgang Macherey, George F. Foster, Llion Jones, Mike Schuster, Noam Shazeer, Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Zhifeng Chen, Yonghui Wu, Macduff Hughes
2018	J	`jnl`	The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. CoRR Mia Xu Chen, Orhan Firat, Ankur Bapna, Melvin Johnson, Wolfgang Macherey, George F. Foster, Llion Jones, Niki Parmar, Mike Schuster, Zhifeng Chen, Yonghui Wu, Macduff Hughes
2018	J	`jnl`	Zero-Shot Cross-lingual Classification Using Multilingual Neural Machine Translation. CoRR Akiko Eriguchi, Melvin Johnson, Orhan Firat, Hideto Kazawa, Wolfgang Macherey
2017	J	`jnl`	Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation. Trans. Assoc. Comput. Linguistics Melvin Johnson, Mike Schuster, Quoc V. Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fernanda B. Viégas, Martin Wattenberg, Greg Corrado, Macduff Hughes, Jeffrey Dean
2016	J	`jnl`	Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation. CoRR Melvin Johnson, Mike Schuster, Quoc V. Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fernanda B. Viégas, Martin Wattenberg, Greg Corrado, Macduff Hughes, Jeffrey Dean
2016	J	`jnl`	Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation. CoRR Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, Jeff Klingner, Apurva Shah, Melvin Johnson, Xiaobing Liu, Lukasz Kaiser, Stephan Gouws, Yoshikiyo Kato, Taku Kudo, Hideto Kazawa, Keith Stevens, George Kurian, Nishant Patil, Wei Wang, Cliff Young, Jason Smith, Jason Riesa, Alex Rudnick, Oriol Vinyals, Greg Corrado, Macduff Hughes, Jeffrey Dean