Naman Goyal

66 papers A* 12A 3Misc 1Journal 37Unranked 13
YearRankTypeTitle / Venue / Authors
2025 A* conf
Scaling Llama 3 Training with Efficient Parallelism Strategies.
ISCA
Weiwei Chu, Xinfeng Xie, Jiecao Yu, Jie Wang, Amar Phanishayee, Chunqiang Tang, Yuchen Hao, Jianyu Huang, Mustafa Ozdal, Jun Wang, Vedanuj Goswami, Naman Goyal, Abhishek Kadian, Andrew Gu, Chris Cai, Feng Tian, Xiaodong Wang, Min Si, Pavan Balaji, Ching-Hsiang Chu, Jongsoo Park
2024 — conf
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants.
ACL (1)
Lucas Bandarkar, Davis Liang, Benjamin Muller, Mikel Artetxe, Satya Narayan Shukla, Donald Husa, Naman Goyal, Abhinandan Krishnan, Luke Zettlemoyer, Madian Khabsa
2023 J jnl
A Theory on Adam Instability in Large-Scale Machine Learning.
CoRR
Igor Molybog, Peter Albert, Moya Chen, Zachary DeVito, David Esiobu, Naman Goyal, Punit Singh Koura, Sharan Narang, Andrew Poulton, Ruan Silva, Binh Tang, Diana Liskovich, Puxin Xu, Yuchen Zhang, Melanie Kambadur, Stephen Roller, Susan Zhang
2023 A* conf
Don't forget the nullspace! Nullspace occupancy as a mechanism for out of distribution failure.
ICLR
Daksh Idnani, Vivek Madan, Naman Goyal, David J. Schwab, Ramakrishna Vedantam
2023 J jnl
LLaMA: Open and Efficient Foundation Language Models.
CoRR
Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurélien Rodriguez, Armand Joulin, Edouard Grave, Guillaume Lample
2023 J jnl
Llama 2: Open Foundation and Fine-Tuned Chat Models.
CoRR
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton-Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Jian Xiang Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurélien Rodriguez, Robert Stojnic, Sergey Edunov, Thomas Scialom
2023 A* conf
Scaling Laws for Generative Mixed-Modal Language Models.
ICML
Armen Aghajanyan, Lili Yu, Alexis Conneau, Wei-Ning Hsu, Karen Hambardzumyan, Susan Zhang, Stephen Roller, Naman Goyal, Omer Levy, Luke Zettlemoyer
2023 J jnl
Scaling Laws for Generative Mixed-Modal Language Models.
CoRR
Armen Aghajanyan, Lili Yu, Alexis Conneau, Wei-Ning Hsu, Karen Hambardzumyan, Susan Zhang, Stephen Roller, Naman Goyal, Omer Levy, Luke Zettlemoyer
2023 A* conf
Text-To-4D Dynamic Scene Generation.
ICML
Uriel Singer, Shelly Sheynin, Adam Polyak, Oron Ashual, Iurii Makarov, Filippos Kokkinos, Naman Goyal, Andrea Vedaldi, Devi Parikh, Justin Johnson, Yaniv Taigman
2023 J jnl
Text-To-4D Dynamic Scene Generation.
CoRR
Uriel Singer, Shelly Sheynin, Adam Polyak, Oron Ashual, Iurii Makarov, Filippos Kokkinos, Naman Goyal, Andrea Vedaldi, Devi Parikh, Justin Johnson, Yaniv Taigman
2023 J jnl
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants.
CoRR
Lucas Bandarkar, Davis Liang, Benjamin Muller, Mikel Artetxe, Satya Narayan Shukla, Donald Husa, Naman Goyal, Abhinandan Krishnan, Luke Zettlemoyer, Madian Khabsa
2023 A* conf
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models.
EMNLP
Davis Liang, Hila Gonen, Yuning Mao, Rui Hou, Naman Goyal, Marjan Ghazvininejad, Luke Zettlemoyer, Madian Khabsa
2023 J jnl
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models.
CoRR
Davis Liang, Hila Gonen, Yuning Mao, Rui Hou, Naman Goyal, Marjan Ghazvininejad, Luke Zettlemoyer, Madian Khabsa
2022 J jnl
BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage.
CoRR
Kurt Shuster, Jing Xu, Mojtaba Komeili, Da Ju, Eric Michael Smith, Stephen Roller, Megan Ung, Moya Chen, Kushal Arora, Joshua Lane, Morteza Behrooz, William Ngan, Spencer Poff, Naman Goyal, Arthur Szlam, Y-Lan Boureau, Melanie Kambadur, Jason Weston
2022 J jnl
CM3: A Causal Masked Multimodal Model of the Internet.
CoRR
Armen Aghajanyan, Bernie Huang, Candace Ross, Vladimir Karpukhin, Hu Xu, Naman Goyal, Dmytro Okhonko, Mandar Joshi, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer
2022 A* conf
Efficient Large Scale Language Modeling with Mixtures of Experts.
EMNLP
Mikel Artetxe, Shruti Bhosale, Naman Goyal, Todor Mihaylov, Myle Ott, Sam Shleifer, Xi Victoria Lin, Jingfei Du, Srinivasan Iyer, Ramakanth Pasunuru, Giridharan Anantharaman, Xian Li, Shuohui Chen, Halil Akin, Mandeep Baines, Louis Martin, Xing Zhou, Punit Singh Koura, Brian O'Horo, Jeffrey Wang, Luke Zettlemoyer, Mona T. Diab, Zornitsa Kozareva, Veselin Stoyanov
2022 A* conf
Few-shot Learning with Multilingual Generative Language Models.
EMNLP
Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona T. Diab, Veselin Stoyanov, Xian Li
2022 Misc conf
How Robust is Neural Machine Translation to Language Imbalance in Multilingual Tokenizer Training?
AMTA
Shiyue Zhang, Vishrav Chaudhary, Naman Goyal, James Cross, Guillaume Wenzek, Mohit Bansal, Francisco Guzmán
2022 J jnl
How Robust is Neural Machine Translation to Language Imbalance in Multilingual Tokenizer Training?
CoRR
Shiyue Zhang, Vishrav Chaudhary, Naman Goyal, James Cross, Guillaume Wenzek, Mohit Bansal, Francisco Guzmán
2022 — conf
Lifting the Curse of Multilinguality by Pre-training Modular Transformers.
NAACL-HLT
Jonas Pfeiffer, Naman Goyal, Xi Victoria Lin, Xian Li, James Cross, Sebastian Riedel, Mikel Artetxe
2022 J jnl
Lifting the Curse of Multilinguality by Pre-training Modular Transformers.
CoRR
Jonas Pfeiffer, Naman Goyal, Xi Victoria Lin, Xian Li, James Cross, Sebastian Riedel, Mikel Artetxe
2022 J jnl
Multilingual Autoregressive Entity Linking.
Trans. Assoc. Comput. Linguistics
Nicola De Cao, Ledell Wu, Kashyap Popat, Mikel Artetxe, Naman Goyal, Mikhail Plekhanov, Luke Zettlemoyer, Nicola Cancedda, Sebastian Riedel, Fabio Petroni
2022 J jnl
OPT: Open Pre-trained Transformer Language Models.
CoRR
Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona T. Diab, Xian Li, Xi Victoria Lin, Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, Luke Zettlemoyer
2022 — conf
On the Role of Bidirectionality in Language Model Pre-Training.
EMNLP (Findings)
Mikel Artetxe, Jingfei Du, Naman Goyal, Luke Zettlemoyer, Veselin Stoyanov
2022 J jnl
On the Role of Bidirectionality in Language Model Pre-Training.
CoRR
Mikel Artetxe, Jingfei Du, Naman Goyal, Luke Zettlemoyer, Ves Stoyanov
2022 J jnl
The Flores-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translation.
Trans. Assoc. Comput. Linguistics
Naman Goyal, Cynthia Gao, Vishrav Chaudhary, Peng-Jen Chen, Guillaume Wenzek, Da Ju, Sanjana Krishnan, Marc'Aurelio Ranzato, Francisco Guzmán, Angela Fan
2022 A conf
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale.
INTERSPEECH
Arun Babu, Changhan Wang, Andros Tjandra, Kushal Lakhotia, Qiantong Xu, Naman Goyal, Kritika Singh, Patrick von Platen, Yatharth Saraf, Juan Pino, Alexei Baevski, Alexis Conneau, Michael Auli
2021 — conf
Adapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel Data.
ACL/IJCNLP (1)
Wei-Jen Ko, Ahmed El-Kishky, Adithya Renduchintala, Vishrav Chaudhary, Naman Goyal, Francisco Guzmán, Pascale Fung, Philipp Koehn, Mona T. Diab
2021 J jnl
Adapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel Data.
CoRR
Wei-Jen Ko, Ahmed El-Kishky, Adithya Renduchintala, Vishrav Chaudhary, Naman Goyal, Francisco Guzmán, Pascale Fung, Philipp Koehn, Mona T. Diab
2021 A* conf
BASE Layers: Simplifying Training of Large, Sparse Models.
ICML
Mike Lewis, Shruti Bhosale, Tim Dettmers, Naman Goyal, Luke Zettlemoyer
2021 J jnl
BASE Layers: Simplifying Training of Large, Sparse Models.
CoRR
Mike Lewis, Shruti Bhosale, Tim Dettmers, Naman Goyal, Luke Zettlemoyer
2021 A* conf
Better Fine-Tuning by Reducing Representational Collapse.
ICLR
Armen Aghajanyan, Akshat Shrivastava, Anchit Gupta, Naman Goyal, Luke Zettlemoyer, Sonal Gupta
2021 J jnl
Beyond English-Centric Multilingual Machine Translation.
J. Mach. Learn. Res.
Angela Fan, Shruti Bhosale, Holger Schwenk, Zhiyi Ma, Ahmed El-Kishky, Siddharth Goyal, Mandeep Baines, Onur Celebi, Guillaume Wenzek, Vishrav Chaudhary, Naman Goyal, Tom Birch, Vitaliy Liptchinsky, Sergey Edunov, Michael Auli, Armand Joulin
2021 J jnl
Efficient Large Scale Language Modeling with Mixtures of Experts.
CoRR
Mikel Artetxe, Shruti Bhosale, Naman Goyal, Todor Mihaylov, Myle Ott, Sam Shleifer, Xi Victoria Lin, Jingfei Du, Srinivasan Iyer, Ramakanth Pasunuru, Giri Anantharaman, Xian Li, Shuohui Chen, Halil Akin, Mandeep Baines, Louis Martin, Xing Zhou, Punit Singh Koura, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Mona T. Diab, Zornitsa Kozareva, Ves Stoyanov
2021 — conf
FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task.
IWSLT
Yun Tang, Hongyu Gong, Xian Li, Changhan Wang, Juan Miguel Pino, Holger Schwenk, Naman Goyal
2021 J jnl
FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task.
CoRR
Yun Tang, Hongyu Gong, Xian Li, Changhan Wang, Juan Miguel Pino, Holger Schwenk, Naman Goyal
2021 J jnl
Few-shot Learning with Multilingual Language Models.
CoRR
Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona T. Diab, Veselin Stoyanov, Xian Li
2021 — conf
Findings of the WMT 2021 Shared Task on Large-Scale Multilingual Machine Translation.
WMT@EMNLP
Guillaume Wenzek, Vishrav Chaudhary, Angela Fan, Sahir Gomez, Naman Goyal, Somya Jain, Douwe Kiela, Tristan Thrush, Francisco Guzmán
2021 — conf
Larger-Scale Transformers for Multilingual Masked Language Modeling.
RepL4NLP@ACL-IJCNLP
Naman Goyal, Jingfei Du, Myle Ott, Giri Anantharaman, Alexis Conneau
2021 J jnl
Larger-Scale Transformers for Multilingual Masked Language Modeling.
CoRR
Naman Goyal, Jingfei Du, Myle Ott, Giri Anantharaman, Alexis Conneau
2021 J jnl
Multilingual Autoregressive Entity Linking.
CoRR
Nicola De Cao, Ledell Wu, Kashyap Popat, Mikel Artetxe, Naman Goyal, Mikhail Plekhanov, Luke Zettlemoyer, Nicola Cancedda, Sebastian Riedel, Fabio Petroni
2021 — conf
Multilingual Translation from Denoising Pre-Training.
ACL/IJCNLP (Findings)
Yuqing Tang, Chau Tran, Xian Li, Peng-Jen Chen, Naman Goyal, Vishrav Chaudhary, Jiatao Gu, Angela Fan
2021 A conf
Recipes for Building an Open-Domain Chatbot.
EACL
Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Eric Michael Smith, Y-Lan Boureau, Jason Weston
2021 J jnl
The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translation.
CoRR
Naman Goyal, Cynthia Gao, Vishrav Chaudhary, Peng-Jen Chen, Guillaume Wenzek, Da Ju, Sanjana Krishnan, Marc'Aurelio Ranzato, Francisco Guzmán, Angela Fan
2021 J jnl
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale.
CoRR
Arun Babu, Changhan Wang, Andros Tjandra, Kushal Lakhotia, Qiantong Xu, Naman Goyal, Kritika Singh, Patrick von Platen, Yatharth Saraf, Juan Pino, Alexei Baevski, Alexis Conneau, Michael Auli
2020 A* conf
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension.
ACL
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, Luke Zettlemoyer
2020 J jnl
Better Fine-Tuning by Reducing Representational Collapse.
CoRR
Armen Aghajanyan, Akshat Shrivastava, Anchit Gupta, Naman Goyal, Luke Zettlemoyer, Sonal Gupta
2020 J jnl
Beyond English-Centric Multilingual Machine Translation.
CoRR
Angela Fan, Shruti Bhosale, Holger Schwenk, Zhiyi Ma, Ahmed El-Kishky, Siddharth Goyal, Mandeep Baines, Onur Celebi, Guillaume Wenzek, Vishrav Chaudhary, Naman Goyal, Tom Birch, Vitaliy Liptchinsky, Sergey Edunov, Edouard Grave, Michael Auli, Armand Joulin
2020 — conf
Facebook AI's WMT20 News Translation Task Submission.
WMT@EMNLP
Peng-Jen Chen, Ann Lee, Changhan Wang, Naman Goyal, Angela Fan, Mary Williamson, Jiatao Gu
2020 J jnl
Facebook AI's WMT20 News Translation Task Submission.
CoRR
Peng-Jen Chen, Ann Lee, Changhan Wang, Naman Goyal, Angela Fan, Mary Williamson, Jiatao Gu
2020 — conf
Findings of the WMT 2020 Shared Task on Parallel Corpus Filtering and Alignment.
WMT@EMNLP
Philipp Koehn, Vishrav Chaudhary, Ahmed El-Kishky, Naman Goyal, Peng-Jen Chen, Francisco Guzmán
2020 J jnl
Multilingual Denoising Pre-training for Neural Machine Translation.
CoRR
Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, Luke Zettlemoyer
2020 J jnl
Multilingual Denoising Pre-training for Neural Machine Translation.
Trans. Assoc. Comput. Linguistics
Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, Luke Zettlemoyer
2020 J jnl
Multilingual Translation with Extensible Multilingual Pretraining and Finetuning.
CoRR
Yuqing Tang, Chau Tran, Xian Li, Peng-Jen Chen, Naman Goyal, Vishrav Chaudhary, Jiatao Gu, Angela Fan
2020 J jnl
Recipes for building an open-domain chatbot.
CoRR
Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Kurt Shuster, Eric Michael Smith, Y-Lan Boureau, Jason Weston
2020 A* conf
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.
NeurIPS
Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, Douwe Kiela
2020 J jnl
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.
CoRR
Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, Douwe Kiela
2020 A* conf
Unsupervised Cross-lingual Representation Learning at Scale.
ACL
Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, Veselin Stoyanov
2019 J jnl
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension.
CoRR
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, Luke Zettlemoyer
2019 J jnl
RoBERTa: A Robustly Optimized BERT Pretraining Approach.
CoRR
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, Veselin Stoyanov
2019 J jnl
Unsupervised Cross-lingual Representation Learning at Scale.
CoRR
Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, Veselin Stoyanov
2017 — conf
LearningToQuestion at SemEval 2017 Task 3: Ranking Similar Questions by Learning to Rank Using Rich Features.
SemEval@ACL
Naman Goyal
2016 — conf
A Joint Model of Rhetorical Discourse Structure and Summarization.
SPNLP@EMNLP
Naman Goyal, Jacob Eisenstein
2016 A conf
Active Learning in Multi-objective Evolutionary Algorithms for Sustainable Building Design.
GECCO
Siamak Safarzadegan Gilan, Naman Goyal, Bistra Dilkina
2016 — conf
The Social Dynamics of Language Change in Online Networks.
SocInfo (1)
Rahul Goel, Sandeep Soni, Naman Goyal, John Paparrizos, Hanna M. Wallach, Fernando Diaz, Jacob Eisenstein
2016 J jnl
The Social Dynamics of Language Change in Online Networks.
CoRR
Rahul Goel, Sandeep Soni, Naman Goyal, John Paparrizos, Hanna M. Wallach, Fernando Diaz, Jacob Eisenstein