Sergey Edunov

48 papers A* 4A 2Misc 1Journal 30Unranked 11
YearRankTypeTitle / Venue / Authors
2026 J jnl
Training LLMs with Fault Tolerant HSDP on 100,000 GPUs.
CoRR
Omkar Salpekar, Rohan Varma, Kenny Yu, Vladimir Ivanov, Yang Wang, Ahmed Sharif, Min Si, Shawn Xu, Feng Tian, Shengbao Zheng, Tristan Rice, Ankush Garg, Shangfu Peng, Shreyas Siravara, Wenyin Fu, Rodrigo de Castro, Adithya Gangidi, Andrey Obraztsov, Sharan Narang, Sergey Edunov, Maxim Naumov, Chunqiang Tang, Mathew Oldham
2025 J jnl
Correlating and Predicting Human Evaluations of Language Models from Natural Language Processing Benchmarks.
CoRR
Rylan Schaeffer, Punit Singh Koura, Binh Tang, Ranjan Subramanian, Aaditya K. Singh, Todor Mihaylov, Prajjwal Bhargava, Lovish Madaan, Niladri S. Chatterji, Vedanuj Goswami, Sergey Edunov, Dieuwke Hupkes, Sanmi Koyejo, Sharan Narang
2025 A* conf
Law of the Weakest Link: Cross Capabilities of Large Language Models.
ICLR
Ming Zhong, Aston Zhang, Xuewei Wang, Rui Hou, Wenhan Xiong, Chenguang Zhu, Zhengxing Chen, Liang Tan, Chloe Bi, Mike Lewis, Sravya Popuri, Sharan Narang, Melanie Kambadur, Dhruv Mahajan, Sergey Edunov, Jiawei Han, Laurens van der Maaten
2024 — conf
Effective Long-Context Scaling of Foundation Models.
NAACL-HLT
Wenhan Xiong, Jingyu Liu, Igor Molybog, Hejia Zhang, Prajjwal Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, Madian Khabsa, Han Fang, Yashar Mehdad, Sharan Narang, Kshitiz Malik, Angela Fan, Shruti Bhosale, Sergey Edunov, Mike Lewis, Sinong Wang, Hao Ma
2024 J jnl
Law of the Weakest Link: Cross Capabilities of Large Language Models.
CoRR
Ming Zhong, Aston Zhang, Xuewei Wang, Rui Hou, Wenhan Xiong, Chenguang Zhu, Zhengxing Chen, Liang Tan, Chloe Bi, Mike Lewis, Sravya Popuri, Sharan Narang, Melanie Kambadur, Dhruv Mahajan, Sergey Edunov, Jiawei Han, Laurens van der Maaten
2023 J jnl
Effective Long-Context Scaling of Foundation Models.
CoRR
Wenhan Xiong, Jingyu Liu, Igor Molybog, Hejia Zhang, Prajjwal Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, Madian Khabsa, Han Fang, Yashar Mehdad, Sharan Narang, Kshitiz Malik, Angela Fan, Shruti Bhosale, Sergey Edunov, Mike Lewis, Sinong Wang, Hao Ma
2023 J jnl
LegoNN: Building Modular Encoder-Decoder Models.
IEEE ACM Trans. Audio Speech Lang. Process.
Siddharth Dalmia, Dmytro Okhonko, Mike Lewis, Sergey Edunov, Shinji Watanabe, Florian Metze, Luke Zettlemoyer, Abdelrahman Mohamed
2023 J jnl
Llama 2: Open Foundation and Fine-Tuned Chat Models.
CoRR
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton-Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Jian Xiang Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurélien Rodriguez, Robert Stojnic, Sergey Edunov, Thomas Scialom
2022 J jnl
LegoNN: Building Modular Encoder-Decoder Models.
CoRR
Siddharth Dalmia, Dmytro Okhonko, Mike Lewis, Sergey Edunov, Shinji Watanabe, Florian Metze, Luke Zettlemoyer, Abdelrahman Mohamed
2022 J jnl
No Language Left Behind: Scaling Human-Centered Machine Translation.
CoRR
Marta R. Costa-jussà, James Cross, Onur Çelebi, Maha Elbayad, Kenneth Heafield, Kevin Heffernan, Elahe Kalbassi, Janice Lam, Daniel Licht, Jean Maillard, Anna Y. Sun, Skyler Wang, Guillaume Wenzek, Al Youngblood, Bapi Akula, Loïc Barrault, Gabriel Mejia Gonzalez, Prangthip Hansanti, John Hoffman, Semarley Jarrett, Kaushik Ram Sadagopan, Dirk Rowe, Shannon Spruit, Chau Tran, Pierre Andrews, Necip Fazil Ayan, Shruti Bhosale, Sergey Edunov, Angela Fan, Cynthia Gao, Vedanuj Goswami, Francisco Guzmán, Philipp Koehn, Alexandre Mourachko, Christophe Ropers, Safiyyah Saleem, Holger Schwenk, Jeff Wang
2021 J jnl
A Comparison of Approaches to Document-level Machine Translation.
CoRR
Zhiyi Ma, Sergey Edunov, Michael Auli
2021 J jnl
Beyond English-Centric Multilingual Machine Translation.
J. Mach. Learn. Res.
Angela Fan, Shruti Bhosale, Holger Schwenk, Zhiyi Ma, Ahmed El-Kishky, Siddharth Goyal, Mandeep Baines, Onur Celebi, Guillaume Wenzek, Vishrav Chaudhary, Naman Goyal, Tom Birch, Vitaliy Liptchinsky, Sergey Edunov, Michael Auli, Armand Joulin
2021 — conf
CCMatrix: Mining Billions of High-Quality Parallel Sentences on the Web.
ACL/IJCNLP (1)
Holger Schwenk, Guillaume Wenzek, Sergey Edunov, Edouard Grave, Armand Joulin, Angela Fan
2021 J jnl
Facebook AI WMT21 News Translation Task Submission.
CoRR
Chau Tran, Shruti Bhosale, James Cross, Philipp Koehn, Sergey Edunov, Angela Fan
2021 — conf
Facebook AI's WMT21 News Translation Task Submission.
WMT@EMNLP
Chau Tran, Shruti Bhosale, James Cross, Philipp Koehn, Sergey Edunov, Angela Fan
2020 J jnl
Beyond English-Centric Multilingual Machine Translation.
CoRR
Angela Fan, Shruti Bhosale, Holger Schwenk, Zhiyi Ma, Ahmed El-Kishky, Siddharth Goyal, Mandeep Baines, Onur Celebi, Guillaume Wenzek, Vishrav Chaudhary, Naman Goyal, Tom Birch, Vitaliy Liptchinsky, Sergey Edunov, Edouard Grave, Michael Auli, Armand Joulin
2020 — conf
Dense Passage Retrieval for Open-Domain Question Answering.
EMNLP (1)
Vladimir Karpukhin, Barlas Oguz, Sewon Min, Patrick Lewis, Ledell Wu, Sergey Edunov, Danqi Chen, Wen-tau Yih
2020 J jnl
Dense Passage Retrieval for Open-Domain Question Answering.
CoRR
Vladimir Karpukhin, Barlas Oguz, Sewon Min, Ledell Wu, Sergey Edunov, Danqi Chen, Wen-tau Yih
2020 — conf
Language Models not just for Pre-training: Fast Online Neural Noisy Channel Modeling.
WMT@EMNLP
Shruti Bhosale, Kyra Yee, Sergey Edunov, Michael Auli
2020 J jnl
Language Models not just for Pre-training: Fast Online Neural Noisy Channel Modeling.
CoRR
Shruti Bhosale, Kyra Yee, Sergey Edunov, Michael Auli
2020 A conf
Large Scale Weakly and Semi-Supervised Learning for Low-Resource Video ASR.
INTERSPEECH
Kritika Singh, Vimal Manohar, Alex Xiao, Sergey Edunov, Ross B. Girshick, Vitaliy Liptchinsky, Christian Fuegen, Yatharth Saraf, Geoffrey Zweig, Abdelrahman Mohamed
2020 J jnl
Large scale weakly and semi-supervised learning for low-resource video ASR.
CoRR
Kritika Singh, Vimal Manohar, Alex Xiao, Sergey Edunov, Ross B. Girshick, Vitaliy Liptchinsky, Christian Fuegen, Yatharth Saraf, Geoffrey Zweig, Abdelrahman Mohamed
2020 J jnl
Multilingual Denoising Pre-training for Neural Machine Translation.
CoRR
Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, Luke Zettlemoyer
2020 J jnl
Multilingual Denoising Pre-training for Neural Machine Translation.
Trans. Assoc. Comput. Linguistics
Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, Luke Zettlemoyer
2020 A* conf
On The Evaluation of Machine Translation SystemsTrained With Back-Translation.
ACL
Sergey Edunov, Myle Ott, Marc'Aurelio Ranzato, Michael Auli
2020 A* conf
Playing the lottery with rewards and multiple languages: lottery tickets in RL and NLP.
ICLR
Haonan Yu, Sergey Edunov, Yuandong Tian, Ari S. Morcos
2020 Misc conf
Training ASR Models By Generation of Contextual Information.
ICASSP
Kritika Singh, Dmytro Okhonko, Jun Liu, Yongqiang Wang, Frank Zhang, Ross B. Girshick, Sergey Edunov, Fuchun Peng, Yatharth Saraf, Geoffrey Zweig, Abdelrahman Mohamed
2019 J jnl
CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEB.
CoRR
Holger Schwenk, Guillaume Wenzek, Sergey Edunov, Edouard Grave, Armand Joulin
2019 — conf
Cloze-driven Pretraining of Self-attention Networks.
EMNLP/IJCNLP (1)
Alexei Baevski, Sergey Edunov, Yinhan Liu, Luke Zettlemoyer, Michael Auli
2019 J jnl
Cloze-driven Pretraining of Self-attention Networks.
CoRR
Alexei Baevski, Sergey Edunov, Yinhan Liu, Luke Zettlemoyer, Michael Auli
2019 — conf
Facebook FAIR's WMT19 News Translation Task Submission.
WMT (2)
Nathan Ng, Kyra Yee, Alexei Baevski, Myle Ott, Michael Auli, Sergey Edunov
2019 J jnl
Facebook FAIR's WMT19 News Translation Task Submission.
CoRR
Nathan Ng, Kyra Yee, Alexei Baevski, Myle Ott, Michael Auli, Sergey Edunov
2019 J jnl
On The Evaluation of Machine Translation Systems Trained With Back-Translation.
CoRR
Sergey Edunov, Myle Ott, Marc'Aurelio Ranzato, Michael Auli
2019 J jnl
Playing the lottery with rewards and multiple languages: lottery tickets in RL and NLP.
CoRR
Haonan Yu, Sergey Edunov, Yuandong Tian, Ari S. Morcos
2019 J jnl
Pre-trained Language Model Representations for Language Generation.
CoRR
Sergey Edunov, Alexei Baevski, Michael Auli
2019 — conf
Pre-trained language model representations for language generation.
NAACL-HLT (1)
Sergey Edunov, Alexei Baevski, Michael Auli
2019 J jnl
Training ASR models by Generation of Contextual Information.
CoRR
Kritika Singh, Dmytro Okhonko, Jun Liu, Yongqiang Wang, Frank Zhang, Ross B. Girshick, Sergey Edunov, Fuchun Peng, Yatharth Saraf, Geoffrey Zweig, Abdelrahman Mohamed
2019 — conf
fairseq: A Fast, Extensible Toolkit for Sequence Modeling.
NAACL-HLT (Demonstrations)
Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, Michael Auli
2019 J jnl
fairseq: A Fast, Extensible Toolkit for Sequence Modeling.
CoRR
Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, Michael Auli
2018 — conf
Classical Structured Prediction Losses for Sequence to Sequence Learning.
NAACL-HLT
Sergey Edunov, Myle Ott, Michael Auli, David Grangier, Marc'Aurelio Ranzato
2018 A conf
Generating Synthetic Social Graphs with Darwini.
ICDCS
Sergey Edunov, Dionysios Logothetis, Cheng Wang, Avery Ching, Maja Kabiljo
2018 — conf
Scaling Neural Machine Translation.
WMT
Myle Ott, Sergey Edunov, David Grangier, Michael Auli
2018 J jnl
Scaling Neural Machine Translation.
CoRR
Myle Ott, Sergey Edunov, David Grangier, Michael Auli
2018 A* conf
Understanding Back-Translation at Scale.
EMNLP
Sergey Edunov, Myle Ott, Michael Auli, David Grangier
2018 J jnl
Understanding Back-Translation at Scale.
CoRR
Sergey Edunov, Myle Ott, Michael Auli, David Grangier
2017 J jnl
Classical Structured Prediction Losses for Sequence to Sequence Learning.
CoRR
Sergey Edunov, Myle Ott, Michael Auli, David Grangier, Marc'Aurelio Ranzato
2016 J jnl
Darwini: Generating realistic large-scale social graphs.
CoRR
Sergey Edunov, Dionysios Logothetis, Cheng Wang, Avery Ching, Maja Kabiljo
2015 J jnl
One Trillion Edges: Graph Processing at Facebook-Scale.
Proc. VLDB Endow.
Avery Ching, Sergey Edunov, Maja Kabiljo, Dionysios Logothetis, Sambavi Muthukrishnan