Sebastian Ruder

184 papers A* 25A 1B 3Journal 96Unranked 52
YearRankTypeTitle / Venue / Authors
2025 J jnl
A Post-trainer's Guide to Multilingual Training Data: Uncovering Cross-lingual Transfer Dynamics.
CoRR
Luísa Shimabucoro, Ahmet Üstün, Marzieh Fadaee, Sebastian Ruder
2025 — conf
AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabic.
ACL (Findings)
Nathaniel Romney Robinson, Shahd Abdelmoneim, Kelly Marchisio, Sebastian Ruder
2025 J jnl
Arbiters of Ambivalence: Challenges of Using LLMs in No-Consensus Tasks.
CoRR
Bhaktipriya Radharapu, Manon Revel, Megan Ung, Sebastian Ruder, Adina Williams
2025 — conf
Arbiters of Ambivalence: Challenges of using LLMs in No-Consensus tasks.
ACL (Findings)
Bhaktipriya Radharapu, Manon Revel, Megan Ung, Sebastian Ruder, Adina Williams
2025 J jnl
Beg to Differ: Understanding Reasoning-Answer Misalignment Across Languages.
CoRR
Anaelia Ovalle, Candace Ross, Sebastian Ruder, Adina Williams, Karen Ullrich, Mark Ibrahim, Levent Sagun
2025 — conf
Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation.
ACL (1)
Shivalika Singh, Angelika Romanou, Clémentine Fourrier, David Ifeoluwa Adelani, Jian Gang Ngui, Daniel Vila-Suero, Peerat Limkonchotiwat, Kelly Marchisio, Wei Qi Leong, Yosephine Susanto, Raymond Ng, Shayne Longpre, Sebastian Ruder, Wei-Yin Ko, Antoine Bosselut, Alice Oh, André F. T. Martins, Leshem Choshen, Daphne Ippolito, Enzo Ferrante, Marzieh Fadaee, Beyza Ermis, Sara Hooker
2025 — conf
M-RewardBench: Evaluating Reward Models in Multilingual Settings.
ACL (1)
Srishti Gureja, Lester James Validad Miranda, Shayekh Bin Islam, Rishabh Maheshwary, Drishti Sharma, Gusti Triandi Winata, Nathan Lambert, Sebastian Ruder, Sara Hooker, Marzieh Fadaee
2025 J jnl
MENLO: From Preferences to Proficiency - Evaluating and Modeling Native-like Quality Across 47 Languages.
CoRR
Chenxi Whitehouse, Sebastian Ruder, Tony Lin, Oksana Kurylo, Haruka Takagi, Janice Lam, Nicolò Busetto, Denise Diaz
2025 J jnl
The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs.
CoRR
Piotr Nawrot, Robert Li, Renjie Huang, Sebastian Ruder, Kelly Marchisio, Edoardo M. Ponti
2024 J jnl
AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabic.
CoRR
Nathaniel R. Robinson, Shahd Abdelmoneim, Kelly Marchisio, Sebastian Ruder
2024 J jnl
Aya 23: Open Weight Releases to Further Multilingual Progress.
CoRR
Viraat Aryabumi, John Dang, Dwarak Talupuru, Saurabh Dash, David Cairuz, Hangyu Lin, Bharat Venkitesh, Madeline Smith, Jon Ander Campos, Yi Chern Tan, Kelly Marchisio, Max Bartolo, Sebastian Ruder, Acyr Locatelli, Julia Kreutzer, Nick Frosst, Aidan N. Gomez, Phil Blunsom, Marzieh Fadaee, Ahmet Üstün, Sara Hooker
2024 — conf
Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning.
ACL (1)
Shivalika Singh, Freddie Vargus, Daniel D'souza, Börje Karlsson, Abinaya Mahendiran, Wei-Yin Ko, Herumb Shandilya, Jay Patel, Deividas Mataciunas, Laura O'Mahony, Mike Zhang, Ramith Hettiarachchi, Joseph Wilson, Marina Machado, Luisa Souza Moura, Dominik Krzeminski, Hakimeh Fadaei, Irem Ergün, Ifeoma Okoh, Aisha Alaagib, Oshan Mudannayake, Zaid Alyafeai, Minh Vu Chien, Sebastian Ruder, Surya Guthikonda, Emad A. Alghamdi, Sebastian Gehrmann, Niklas Muennighoff, Max Bartolo, Julia Kreutzer, Ahmet Üstün, Marzieh Fadaee, Sara Hooker
2024 J jnl
Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning.
CoRR
Shivalika Singh, Freddie Vargus, Daniel D'souza, Börje F. Karlsson, Abinaya Mahendiran, Wei-Yin Ko, Herumb Shandilya, Jay Patel, Deividas Mataciunas, Laura O'Mahony, Mike Zhang, Ramith Hettiarachchi, Joseph Wilson, Marina Machado, Luisa Souza Moura, Dominik Krzeminski, Hakimeh Fadaei, Irem Ergün, Ifeoma Okoh, Aisha Alaagib, Oshan Mudannayake, Zaid Alyafeai, Minh Chien Vu, Sebastian Ruder, Surya Guthikonda, Emad A. Alghamdi, Sebastian Gehrmann, Niklas Muennighoff, Max Bartolo, Julia Kreutzer, Ahmet Üstün, Marzieh Fadaee, Sara Hooker
2024 A* conf
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts.
NeurIPS
Qizhen (Irene) Zhang, Nikolas Gritsch, Dwaraknath Gnaneshwar, Simon Guo, David Cairuz, Bharat Venkitesh, Jakob N. Foerster, Phil Blunsom, Sebastian Ruder, Ahmet Üstün, Acyr Locatelli
2024 J jnl
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts.
CoRR
Qizhen Zhang, Nikolas Gritsch, Dwaraknath Gnaneshwar, Simon Guo, David Cairuz, Bharat Venkitesh, Jakob N. Foerster, Phil Blunsom, Sebastian Ruder, Ahmet Üstün, Acyr Locatelli
2024 — conf
BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer.
NAACL-HLT
Akari Asai, Sneha Kudugunta, Xinyan Yu, Terra Blevins, Hila Gonen, Machel Reid, Yulia Tsvetkov, Sebastian Ruder, Hannaneh Hajishirzi
2024 — conf
Connecting Language Technologies with Rich, Diverse Data Sources Covering Thousands of Languages.
LREC/COLING
Daan van Esch, Sandy Ritchie, Sebastian Ruder, Julia Kreutzer, Clara Rivera, Ishank Saxena, Isaac Caswell
2024 — conf
How Does Quantization Affect Multilingual LLMs?
EMNLP (Findings)
Kelly Marchisio, Saurabh Dash, Hongyu Chen, Dennis Aumiller, Ahmet Üstün, Sara Hooker, Sebastian Ruder
2024 J jnl
How Does Quantization Affect Multilingual LLMs?
CoRR
Kelly Marchisio, Saurabh Dash, Hongyu Chen, Dennis Aumiller, Ahmet Üstün, Sara Hooker, Sebastian Ruder
2024 J jnl
LLM See, LLM Do: Guiding Data Generation to Target Non-Differentiable Objectives.
CoRR
Luísa Shimabucoro, Sebastian Ruder, Julia Kreutzer, Marzieh Fadaee, Sara Hooker
2024 A* conf
LLM See, LLM Do: Leveraging Active Inheritance to Target Non-Differentiable Objectives.
EMNLP
Luísa Shimabucoro, Sebastian Ruder, Julia Kreutzer, Marzieh Fadaee, Sara Hooker
2024 J jnl
M-RewardBench: Evaluating Reward Models in Multilingual Settings.
CoRR
Srishti Gureja, Lester James V. Miranda, Shayekh Bin Islam, Rishabh Maheshwary, Drishti Sharma, Gusti Winata, Nathan Lambert, Sebastian Ruder, Sara Hooker, Marzieh Fadaee
2024 A* conf
SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages.
EMNLP
Holy Lovenia, Rahmad Mahendra, Salsabil Maulana Akbar, Lester James V. Miranda, Jennifer Santoso, Elyanah Aco, Akhdan Fadhilah, Jonibek Mansurov, Joseph Marvin Imperial, Onno Kampman, Joel Ruben Antony Moniz, Muhammad Ravi Shulthan Habibi, Frederikus Hudi, Jann Railey Montalan, Ryan Hadiwijaya, Joanito Agili Lopo, William Nixon, Börje Karlsson, James Jaya, Ryandito Diandaru, Yuze Gao, Patrick Amadeus Irawan, Bin Wang, Jan Christian Blaise Cruz, Chenxi Whitehouse, Ivan Halim Parmonangan, Maria Khelli, Wenyu Zhang, Lucky Susanto, Reynard Adha Ryanda, Sonny Lazuardi Hermawan, Dan John Velasco, Muhammad Dehan Al Kautsar, Willy Fitra Hendria, Yasmin Moslem, Noah Flynn, Muhammad Farid Adilazuarda, Haochen Li, Johanes Lee, R. Damanhuri, Shuo Sun, Muhammad Reza Qorib, Amirbek Djanibekov, Wei Qi Leong, Quyet V. Do, Niklas Muennighoff, Tanrada Pansuwan, Ilham Firdausi Putra, Yan Xu, Ngee Tai Chia, Ayu Purwarianti, Sebastian Ruder, William-Chandra Tjhi, Peerat Limkonchotiwat, Alham Fikri Aji, Sedrick Keh, Genta Indra Winata, Ruochen Zhang, Fajri Koto, Zheng Xin Yong, Samuel Cahyawijaya
2024 J jnl
SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages.
CoRR
Holy Lovenia, Rahmad Mahendra, Salsabil Maulana Akbar, Lester James V. Miranda, Jennifer Santoso, Elyanah Aco, Akhdan Fadhilah, Jonibek Mansurov, Joseph Marvin Imperial, Onno Pepijn Kampman, Joel Ruben Antony Moniz, Muhammad Ravi Shulthan Habibi, Frederikus Hudi, Railey Montalan, Ryan Ignatius, Joanito Agili Lopo, William Nixon, Börje F. Karlsson, James Jaya, Ryandito Diandaru, Yuze Gao, Patrick Amadeus Irawan, Bin Wang, Jan Christian Blaise Cruz, Chenxi Whitehouse, Ivan Halim Parmonangan, Maria Khelli, Wenyu Zhang, Lucky Susanto, Reynard Adha Ryanda, Sonny Lazuardi Hermawan, Dan John Velasco, Muhammad Dehan Al Kautsar, Willy Fitra Hendria, Yasmin Moslem, Noah Flynn, Muhammad Farid Adilazuarda, Haochen Li, Johanes Lee, R. Damanhuri, Shuo Sun, Muhammad Reza Qorib, Amirbek Djanibekov, Wei Qi Leong, Quyet V. Do, Niklas Muennighoff, Tanrada Pansuwan, Ilham Firdausi Putra, Yan Xu, Ngee Chia Tai, Ayu Purwarianti, Sebastian Ruder, William-Chandra Tjhi, Peerat Limkonchotiwat, Alham Fikri Aji, Sedrick Keh, Genta Indra Winata, Ruochen Zhang, Fajri Koto, Zheng Xin Yong, Samuel Cahyawijaya
2024 A* conf
Understanding and Mitigating Language Confusion in LLMs.
EMNLP
Kelly Marchisio, Wei-Yin Ko, Alexandre Berard, Théo Dehaze, Sebastian Ruder
2024 J jnl
Understanding and Mitigating Language Confusion in LLMs.
CoRR
Kelly Marchisio, Wei-Yin Ko, Alexandre Bérard, Théo Dehaze, Sebastian Ruder
2023 — conf
Adapters: A Unified Library for Parameter-Efficient and Modular Transfer Learning.
EMNLP (Demos)
Clifton Poth, Hannah Sterz, Indraneil Paul, Sukannya Purkayastha, Leon Engländer, Timo Imhof, Ivan Vulic, Sebastian Ruder, Iryna Gurevych, Jonas Pfeiffer
2023 J jnl
Adapters: A Unified Library for Parameter-Efficient and Modular Transfer Learning.
CoRR
Clifton Poth, Hannah Sterz, Indraneil Paul, Sukannya Purkayastha, Leon Engländer, Timo Imhof, Ivan Vulic, Sebastian Ruder, Iryna Gurevych, Jonas Pfeiffer
2023 J jnl
AfriQA: Cross-lingual Open-Retrieval Question Answering for African Languages.
CoRR
Odunayo Ogundepo, Tajuddeen R. Gwadabe, Clara E. Rivera, Jonathan H. Clark, Sebastian Ruder, David Ifeoluwa Adelani, Bonaventure F. P. Dossou, Abdou Aziz Diop, Claytone Sikasote, Gilles Hacheme, Happy Buzaaba, Ignatius Ezeani, Rooweither Mabuya, Salomey Osei, Chris Emezue, Albert Njoroge Kahira, Shamsuddeen Hassan Muhammad, Akintunde Oladipo, Abraham Toluwase Owodunni, Atnafu Lambebo Tonja, Iyanuoluwa Shode, Akari Asai, Tunde Oluwaseyi Ajayi, Clemencia Siro, Steven Arthur, Mofetoluwa Adeyemi, Orevaoghene Ahia, Aremu Anuoluwapo, Oyinkansola Awosan, Chiamaka Chukwuneke, Bernard Opoku, Awokoya Ayodele, Verrah Otiende, Christine Mwase, Boyd Sinkala, Andre Niyongabo Rubungo, Daniel A. Ajisafe, Emeka Felix Onwuegbuzia, Habib Mbow, Emile Niyomutabazi, Eunice Mukonde, Falalu Ibrahim Lawan, Ibrahim Said Ahmad, Jesujoba O. Alabi, Martin Namukombo, Chinedu Emmanuel Mbonu, Mofya Phiri, Neo Putini, Ndumiso Mngoma, Priscilla A. Amuok, Ruqayya Nasir Iro, Sonia Adhiambo
2023 A* conf
AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languages.
EMNLP
Shamsuddeen Hassan Muhammad, Idris Abdulmumin, Abinew Ali Ayele, Nedjma Ousidhoum, David Ifeoluwa Adelani, Seid Muhie Yimam, Ibrahim Said Ahmad, Meriem Beloucif, Saif M. Mohammad, Sebastian Ruder, Oumaima Hourrane, Alípio Jorge, Pavel Brazdil, Felermino Dário Mário António Ali, Davis David, Salomey Osei, Bello Shehu Bello, Falalu Ibrahim Lawan, Tajuddeen Gwadabe, Samuel Rutunda, Tadesse Destaw Belay, Wendimu Baye Messelle, Hailu Beshada Balcha, Sisay Adugna Chala, Hagos Tesfahun Gebremichael, Bernard Opoku, Stephen Arthur
2023 J jnl
AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languages.
CoRR
Shamsuddeen Hassan Muhammad, Idris Abdulmumin, Abinew Ali Ayele, Nedjma Ousidhoum, David Ifeoluwa Adelani, Seid Muhie Yimam, Ibrahim Said Ahmad, Meriem Beloucif, Saif M. Mohammad, Sebastian Ruder, Oumaima Hourrane, Pavel Brazdil, Felermino Dário Mário António Ali, Davis David, Salomey Osei, Bello Shehu Bello, Falalu Ibrahim, Tajuddeen Gwadabe, Samuel Rutunda, Tadesse Destaw Belay, Wendimu Baye Messelle, Hailu Beshada Balcha, Sisay Adugna Chala, Hagos Tesfahun Gebremichael, Bernard Opoku, Steven Arthur
2023 J jnl
BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer.
CoRR
Akari Asai, Sneha Kudugunta, Xinyan Velocity Yu, Terra Blevins, Hila Gonen, Machel Reid, Yulia Tsvetkov, Sebastian Ruder, Hannaneh Hajishirzi
2023 — conf
Cross-lingual Open-Retrieval Question Answering for African Languages.
EMNLP (Findings)
Odunayo Ogundepo, Tajuddeen Gwadabe, Clara Rivera, Jonathan H. Clark, Sebastian Ruder, David Ifeoluwa Adelani, Bonaventure Dossou, Abdou Aziz Diop, Claytone Sikasote, Gilles Hacheme, Happy Buzaaba, Ignatius Ezeani, Rooweither Mabuya, Salomey Osei, Chris Emezue, Albert Kahira, Shamsuddeen Hassan Muhammad, Akintunde Oladipo, Abraham Toluwase Owodunni, Atnafu Lambebo Tonja, Iyanuoluwa Shode, Akari Asai, Aremu Anuoluwapo, Ayodele Awokoya, Bernard Opoku, Chiamaka Chukwuneke, Christine Mwase, Clemencia Siro, Stephen Arthur, Tunde Ajayi, Verrah Otiende, Andre Niyongabo Rubungo, Boyd Sinkala, Daniel A. Ajisafe, Emeka Onwuegbuzia, Falalu Ibrahim Lawan, Ibrahim Said Ahmad, Jesujoba O. Alabi, Chinedu E. Mbonu, Mofetoluwa Adeyemi, Mofya Phiri, Orevaoghene Ahia, Ruqayya Nasir Iro, Sonia Adhiambo
2023 — conf
Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features.
ACL (1)
Ester Hlavnova, Sebastian Ruder
2023 J jnl
Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features.
CoRR
Ester Hlavnova, Sebastian Ruder
2023 A* conf
Evaluating and Modeling Attribution for Cross-Lingual Question Answering.
EMNLP
Benjamin Muller, John Wieting, Jonathan H. Clark, Tom Kwiatkowski, Sebastian Ruder, Livio Soares, Roee Aharoni, Jonathan Herzig, Xinyi Wang
2023 J jnl
Evaluating and Modeling Attribution for Cross-Lingual Question Answering.
CoRR
Benjamin Muller, John Wieting, Jonathan H. Clark, Tom Kwiatkowski, Sebastian Ruder, Livio Baldini Soares, Roee Aharoni, Jonathan Herzig, Xinyi Wang
2023 — conf
Evaluating the Diversity, Equity, and Inclusion of NLP Technology: A Case Study for Indian Languages.
EACL (Findings)
Simran Khanuja, Sebastian Ruder, Partha Talukdar
2023 J jnl
Language and Task Arithmetic with Parameter-Efficient Layers for Zero-Shot Summarization.
CoRR
Alexandra Chronopoulou, Jonas Pfeiffer, Joshua Maynez, Xinyi Wang, Sebastian Ruder, Priyanka Agrawal
2023 A* conf
Language models are multilingual chain-of-thought reasoners.
ICLR
Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, Jason Wei
2023 J jnl
Modular Deep Learning.
CoRR
Jonas Pfeiffer, Sebastian Ruder, Ivan Vulic, Edoardo Maria Ponti
2023 J jnl
Modular Deep Learning.
Trans. Mach. Learn. Res.
Jonas Pfeiffer, Sebastian Ruder, Ivan Vulic, Edoardo M. Ponti
2023 — conf
NusaCrowd: Open Source Initiative for Indonesian NLP Resources.
ACL (Findings)
Samuel Cahyawijaya, Holy Lovenia, Alham Fikri Aji, Genta Indra Winata, Bryan Wilie, Fajri Koto, Rahmad Mahendra, Christian Wibisono, Ade Romadhony, Karissa Vincentio, Jennifer Santoso, David Moeljadi, Cahya Wirawan, Frederikus Hudi, Muhammad Satrio Wicaksono, Ivan Halim Parmonangan, Ika Alfina, Ilham Firdausi Putra, Samsul Rahmadani, Yulianti Oenang, Ali Akbar Septiandri, James Jaya, Kaustubh D. Dhole, Arie Ardiyanti Suryani, Rifki Afina Putri, Dan Su, Keith Stevens, Made Nindyatama Nityasya, Muhammad Farid Adilazuarda, Ryan Hadiwijaya, Ryandito Diandaru, Tiezheng Yu, Vito Ghifari, Wenliang Dai, Yan Xu, Dyah Damapuspita, Haryo Akbarianto Wibowo, Cuk Tho, Ichwanul Muslim Karo Karo, Tirana Fatyanosa, Ziwei Ji, Graham Neubig, Timothy Baldwin, Sebastian Ruder, Pascale Fung, Herry Sujaini, Sakriani Sakti, Ayu Purwarianti
2023 J jnl
PaLM 2 Technical Report.
CoRR
Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, Eric Chu, Jonathan H. Clark, Laurent El Shafey, Yanping Huang, Kathy Meier-Hellstern, Gaurav Mishra, Erica Moreira, Mark Omernick, Kevin Robinson, Sebastian Ruder, Yi Tay, Kefan Xiao, Yuanzhong Xu, Yujing Zhang, Gustavo Hernández Ábrego, Junwhan Ahn, Jacob Austin, Paul Barham, Jan A. Botha, James Bradbury, Siddhartha Brahma, Kevin Brooks, Michele Catasta, Yong Cheng, Colin Cherry, Christopher A. Choquette-Choo, Aakanksha Chowdhery, Clément Crepy, Shachi Dave, Mostafa Dehghani, Sunipa Dev, Jacob Devlin, Mark Díaz, Nan Du, Ethan Dyer, Vladimir Feinberg, Fangxiaoyu Feng, Vlad Fienber, Markus Freitag, Xavier Garcia, Sebastian Gehrmann, Lucas Gonzalez, et al.
2023 J jnl
QAmeleon: Multilingual QA with Only 5 Examples.
Trans. Assoc. Comput. Linguistics
Priyanka Agrawal, Chris Alberti, Fantine Huot, Joshua Maynez, Ji Ma, Sebastian Ruder, Kuzman Ganchev, Dipanjan Das, Mirella Lapata
2023 — conf
Romanization-based Large-scale Adaptation of Multilingual Language Models.
EMNLP (Findings)
Sukannya Purkayastha, Sebastian Ruder, Jonas Pfeiffer, Iryna Gurevych, Ivan Vulic
2023 J jnl
Romanization-based Large-scale Adaptation of Multilingual Language Models.
CoRR
Sukannya Purkayastha, Sebastian Ruder, Jonas Pfeiffer, Iryna Gurevych, Ivan Vulic
2023 — conf
SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval).
SemEval@ACL
Shamsuddeen Hassan Muhammad, Idris Abdulmumin, Seid Muhie Yimam, David Ifeoluwa Adelani, Ibrahim Said Ahmad, Nedjma Ousidhoum, Abinew Ali Ayele, Saif M. Mohammad, Meriem Beloucif, Sebastian Ruder
2023 J jnl
SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval).
CoRR
Shamsuddeen Hassan Muhammad, Idris Abdulmumin, Seid Muhie Yimam, David Ifeoluwa Adelani, Ibrahim Said Ahmad, Nedjma Ousidhoum, Abinew Ali Ayele, Saif M. Mohammad, Meriem Beloucif, Sebastian Ruder
2023 — conf
TaTA: A Multilingual Table-to-Text Dataset for African Languages.
EMNLP (Findings)
Sebastian Gehrmann, Sebastian Ruder, Vitaly Nikolaev, Jan A. Botha, Michael Chavinda, Ankur P. Parikh, Clara Rivera
2023 — conf
XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages.
EMNLP (Findings)
Sebastian Ruder, Jonathan H. Clark, Alexander Gutkin, Mihir Kale, Min Ma, Massimo Nicosia, Shruti Rijhwani, Parker Riley, Jean Michel A. Sarr, Xinyi Wang, John Wieting, Nitish Gupta, Anna Katanova, Christo Kirov, Dana L. Dickinson, Brian Roark, Bidisha Samanta, Connie Tao, David Ifeoluwa Adelani, Vera Axelrod, Isaac Caswell, Colin Cherry, Dan Garrette, R. Reeve Ingle, Melvin Johnson, Dmitry Panteleev, Partha Talukdar
2023 J jnl
XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages.
CoRR
Sebastian Ruder, Jonathan H. Clark, Alexander Gutkin, Mihir Kale, Min Ma, Massimo Nicosia, Shruti Rijhwani, Parker Riley, Jean Michel A. Sarr, Xinyi Wang, John Wieting, Nitish Gupta, Anna Katanova, Christo Kirov, Dana L. Dickinson, Brian Roark, Bidisha Samanta, Connie Tao, David Ifeoluwa Adelani, Vera Axelrod, Isaac Caswell, Colin Cherry, Dan Garrette, R. Reeve Ingle, Melvin Johnson, Dmitry Panteleev, Partha Talukdar
2023 — conf
mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations.
EMNLP (Findings)
Jonas Pfeiffer, Francesco Piccinno, Massimo Nicosia, Xinyi Wang, Machel Reid, Sebastian Ruder
2023 J jnl
mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations.
CoRR
Jonas Pfeiffer, Francesco Piccinno, Massimo Nicosia, Xinyi Wang, Machel Reid, Sebastian Ruder
2022 A* conf
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization.
ICLR
Yi Tay, Vinh Q. Tran, Sebastian Ruder, Jai Prakash Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, Donald Metzler
2022 J jnl
Evaluating Inclusivity, Equity, and Accessibility of NLP Technology: A Case Study for Indian Languages.
CoRR
Simran Khanuja, Sebastian Ruder, Partha P. Talukdar
2022 A* conf
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning.
ICLR
Vamsi Aribandi, Yi Tay, Tal Schuster, Jinfeng Rao, Huaixiu Steven Zheng, Sanket Vaibhav Mehta, Honglei Zhuang, Vinh Q. Tran, Dara Bahri, Jianmo Ni, Jai Prakash Gupta, Kai Hui, Sebastian Ruder, Donald Metzler
2022 — conf
Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation.
ACL (1)
Xinyi Wang, Sebastian Ruder, Graham Neubig
2022 J jnl
Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation.
CoRR
Xinyi Wang, Sebastian Ruder, Graham Neubig
2022 — conf
FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding.
ACL (1)
Yanan Zheng, Jing Zhou, Yujie Qian, Ming Ding, Chonghua Liao, Li Jian, Ruslan Salakhutdinov, Jie Tang, Sebastian Ruder, Zhilin Yang
2022 — ed.
Findings of the Association for Computational Linguistics: AACL-IJCNLP 2022, Online only, November 20-23, 2022
AACL/IJCNLP (Findings)
Yulan He, Heng Ji, Yang Liu, Sujian Li, Chia-Hui Chang, Soujanya Poria, Chenghua Lin, Wray L. Buntine, Maria Liakata, Hanqi Yan, Zonghan Yan, Sebastian Ruder, Xiaojun Wan, Miguel Arana-Catania, Zhongyu Wei, Hen-Hsen Huang, Jheng-Long Wu, Min-Yuh Day, Pengfei Liu, Ruifeng Xu
2022 A* conf
Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer.
EMNLP
Ahmet Üstün, Arianna Bisazza, Gosse Bouma, Gertjan van Noord, Sebastian Ruder
2022 J jnl
Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer.
CoRR
Ahmet Üstün, Arianna Bisazza, Gosse Bouma, Gertjan van Noord, Sebastian Ruder
2022 J jnl
Language Models are Multilingual Chain-of-Thought Reasoners.
CoRR
Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, Jason Wei
2022 A* conf
MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition.
EMNLP
David Ifeoluwa Adelani, Graham Neubig, Sebastian Ruder, Shruti Rijhwani, Michael Beukman, Chester Palen-Michel, Constantine Lignos, Jesujoba O. Alabi, Shamsuddeen Hassan Muhammad, Peter Nabende, Cheikh M. Bamba Dione, Andiswa Bukula, Rooweither Mabuya, Bonaventure F. P. Dossou, Blessing K. Sibanda, Happy Buzaaba, Jonathan Mukiibi, Godson Kalipe, Derguene Mbaye, Amelia V. Taylor, Fatoumata Ouoba Kabore, Chris Chinenye Emezue, Aremu Anuoluwapo, Perez Ogayo, Catherine Gitau, Edwin Munkoh-Buabeng, Victoire Memdjokam Koagne, Allahsera Auguste Tapo, Tebogo Macucwa, Vukosi Marivate, Elvis Mboning, Tajuddeen Gwadabe, Tosin P. Adewumi, Orevaoghene Ahia, Joyce Nakatumba-Nabende, Neo L. Mokono, Ignatius Ezeani, Chiamaka Chukwuneke, Mofetoluwa Adeyemi, Gilles Hacheme, Idris Abdulmumin, Odunayo Ogundepo, Oreen Yousuf, Tatiana Moteu Ngoli, Dietrich Klakow
2022 J jnl
MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition.
CoRR
David Ifeoluwa Adelani, Graham Neubig, Sebastian Ruder, Shruti Rijhwani, Michael Beukman, Chester Palen-Michel, Constantine Lignos, Jesujoba O. Alabi, Shamsuddeen Hassan Muhammad, Peter Nabende, Cheikh M. Bamba Dione, Andiswa Bukula, Rooweither Mabuya, Bonaventure F. P. Dossou, Blessing K. Sibanda, Happy Buzaaba, Jonathan Mukiibi, Godson Kalipe, Derguene Mbaye, Amelia V. Taylor, Fatoumata Ouoba Kabore, Chris Chinenye Emezue, Aremu Anuoluwapo, Perez Ogayo, Catherine Gitau, Edwin Munkoh-Buabeng, Victoire Memdjokam Koagne, Allahsera Auguste Tapo, Tebogo Macucwa, Vukosi Marivate, Elvis Mboning, Tajuddeen Gwadabe, Tosin P. Adewumi, Orevaoghene Ahia, Joyce Nakatumba-Nabende, Neo L. Mokono, Ignatius Ezeani, Chiamaka Chukwuneke, Mofetoluwa Adeyemi, Gilles Hacheme, Idris Abdulmumin, Odunayo Ogundepo, Oreen Yousuf, Tatiana Moteu Ngoli, Dietrich Klakow
2022 — conf
Memorisation versus Generalisation in Pre-trained Language Models.
ACL (1)
Michael Tänzer, Sebastian Ruder, Marek Rei
2022 — conf
Modular and Parameter-Efficient Fine-Tuning for NLP Models.
EMNLP (Tutorial Abstracts)
Sebastian Ruder, Jonas Pfeiffer, Ivan Vulic
2022 J jnl
NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysis.
CoRR
Shamsuddeen Hassan Muhammad, David Ifeoluwa Adelani, Sebastian Ruder, Ibrahim Said Ahmad, Idris Abdulmumin, Bello Shehu Bello, Monojit Choudhury, Chris Chinenye Emezue, Saheed Abdullahi Salahudeen, Aremu Anuoluwapo, Alípio Jeorge, Pavel Brazdil
2022 J jnl
NusaCrowd: Open Source Initiative for Indonesian NLP Resources.
CoRR
Samuel Cahyawijaya, Holy Lovenia, Alham Fikri Aji, Genta Indra Winata, Bryan Wilie, Rahmad Mahendra, Christian Wibisono, Ade Romadhony, Karissa Vincentio, Fajri Koto, Jennifer Santoso, David Moeljadi, Cahya Wirawan, Frederikus Hudi, Ivan Halim Parmonangan, Ika Alfina, Muhammad Satrio Wicaksono, Ilham Firdausi Putra, Samsul Rahmadani, Yulianti Oenang, Ali Akbar Septiandri, James Jaya, Kaustubh D. Dhole, Arie Ardiyanti Suryani, Rifki Afina Putri, Dan Su, Keith Stevens, Made Nindyatama Nityasya, Muhammad Farid Adilazuarda, Ryan Ignatius, Ryandito Diandaru, Tiezheng Yu, Vito Ghifari, Wenliang Dai, Yan Xu, Dyah Damapuspita, Cuk Tho, Ichwanul Muslim Karo Karo, Tirana Noor Fatyanosa, Ziwei Ji, Pascale Fung, Graham Neubig, Timothy Baldwin, Sebastian Ruder, Herry Sujaini, Sakriani Sakti, Ayu Purwarianti
2022 J jnl
NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages.
CoRR
Genta Indra Winata, Alham Fikri Aji, Samuel Cahyawijaya, Rahmad Mahendra, Fajri Koto, Ade Romadhony, Kemal Kurniawan, David Moeljadi, Radityo Eko Prasojo, Pascale Fung, Timothy Baldwin, Jey Han Lau, Rico Sennrich, Sebastian Ruder
2022 — conf
One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia.
ACL (1)
Alham Fikri Aji, Genta Indra Winata, Fajri Koto, Samuel Cahyawijaya, Ade Romadhony, Rahmad Mahendra, Kemal Kurniawan, David Moeljadi, Radityo Eko Prasojo, Timothy Baldwin, Jey Han Lau, Sebastian Ruder
2022 J jnl
One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia.
CoRR
Alham Fikri Aji, Genta Indra Winata, Fajri Koto, Samuel Cahyawijaya, Ade Romadhony, Rahmad Mahendra, Kemal Kurniawan, David Moeljadi, Radityo Eko Prasojo, Timothy Baldwin, Jey Han Lau, Sebastian Ruder
2022 — ed.
Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing, AACL/IJCNLP 2022 - Student Research Workshop, Online, November 20, 2022
AACL/IJCNLP 2022 (Student Research Workshop)
Hanqi Yan, Zonghan Yang, Sebastian Ruder, Xiaojun Wan
2022 — ed.
Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing, AACL/IJCNLP 2022 - Volume 1: Long Papers, Online Only, November 20-23, 2022
AACL/IJCNLP (1)
Yulan He, Heng Ji, Yang Liu, Sujian Li, Chia-Hui Chang, Soujanya Poria, Chenghua Lin, Wray L. Buntine, Maria Liakata, Hanqi Yan, Zonghan Yan, Sebastian Ruder, Xiaojun Wan, Miguel Arana-Catania, Zhongyu Wei, Hen-Hsen Huang, Jheng-Long Wu, Min-Yuh Day, Pengfei Liu, Ruifeng Xu
2022 — ed.
Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing, AACL/IJCNLP 2022 - Volume 2: Short Papers, Online only, November 20-23, 2022
AACL/IJCNLP (2)
Yulan He, Heng Ji, Yang Liu, Sujian Li, Chia-Hui Chang, Soujanya Poria, Chenghua Lin, Wray L. Buntine, Maria Liakata, Hanqi Yan, Zonghan Yan, Sebastian Ruder, Xiaojun Wan, Miguel Arana-Catania, Zhongyu Wei, Hen-Hsen Huang, Jheng-Long Wu, Min-Yuh Day, Pengfei Liu, Ruifeng Xu
2022 J jnl
QAmeleon: Multilingual QA with Only 5 Examples.
CoRR
Priyanka Agrawal, Chris Alberti, Fantine Huot, Joshua Maynez, Ji Ma, Sebastian Ruder, Kuzman Ganchev, Dipanjan Das, Mirella Lapata
2022 — conf
Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold.
ACL (Findings)
Sebastian Ruder, Ivan Vulic, Anders Søgaard
2022 J jnl
Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold.
CoRR
Sebastian Ruder, Ivan Vulic, Anders Søgaard
2022 J jnl
TaTa: A Multilingual Table-to-Text Dataset for African Languages.
CoRR
Sebastian Gehrmann, Sebastian Ruder, Vitaly Nikolaev, Jan A. Botha, Michael Chavinda, Ankur P. Parikh, Clara Rivera
2022 — ed.
Transfer Learning for Natural Language Processing Workshop, 03 December 2022, New Orleans, Louisiana, USA
TL4NLP
Alon Albalak, Chunting Zhou, Colin Raffel, Deepak Ramachandran, Sebastian Ruder, Xuezhe Ma
2022 B conf
Writing System and Speaker Metadata for 2, 800+ Language Varieties.
LREC
Daan van Esch, Tamar Lucassen, Sebastian Ruder, Isaac Caswell, Clara Rivera
2022 A conf
XTREME-S: Evaluating Cross-lingual Speech Representations.
INTERSPEECH
Alexis Conneau, Ankur Bapna, Yu Zhang, Min Ma, Patrick von Platen, Anton Lozhkov, Colin Cherry, Ye Jia, Clara Rivera, Mihir Kale, Daan van Esch, Vera Axelrod, Simran Khanuja, Jonathan H. Clark, Orhan Firat, Michael Auli, Sebastian Ruder, Jason Riesa, Melvin Johnson
2022 J jnl
XTREME-S: Evaluating Cross-lingual Speech Representations.
CoRR
Alexis Conneau, Ankur Bapna, Yu Zhang, Min Ma, Patrick von Platen, Anton Lozhkov, Colin Cherry, Ye Jia, Clara Rivera, Mihir Kale, Daan van Esch, Vera Axelrod, Simran Khanuja, Jonathan H. Clark, Orhan Firat, Michael Auli, Sebastian Ruder, Jason Riesa, Melvin Johnson
2021 A* conf
Analogy Training Multilingual Encoders.
AAAI
Nicolas Garneau, Mareike Hartmann, Anders Sandholm, Sebastian Ruder, Ivan Vulic, Anders Søgaard
2021 J jnl
BERT memorisation and pitfalls in low-resource scenarios.
CoRR
Michael Tänzer, Sebastian Ruder, Marek Rei
2021 J jnl
Balancing Average and Worst-case Accuracy in Multitask Learning.
CoRR
Paul Michel, Sebastian Ruder, Dani Yogatama
2021 J jnl
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization.
CoRR
Yi Tay, Vinh Q. Tran, Sebastian Ruder, Jai Prakash Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, Donald Metzler
2021 A* conf
Compacter: Efficient Low-Rank Hypercomplex Adapter Layers.
NeurIPS
Rabeeh Karimi Mahabadi, James Henderson, Sebastian Ruder
2021 J jnl
Compacter: Efficient Low-Rank Hypercomplex Adapter Layers.
CoRR
Rabeeh Karimi Mahabadi, James Henderson, Sebastian Ruder
2021 — conf
Efficient Test Time Adapter Ensembling for Low-resource Language Varieties.
EMNLP (Findings)
Xinyi Wang, Yulia Tsvetkov, Sebastian Ruder, Graham Neubig
2021 J jnl
Efficient Test Time Adapter Ensembling for Low-resource Language Varieties.
CoRR
Xinyi Wang, Yulia Tsvetkov, Sebastian Ruder, Graham Neubig
2021 J jnl
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning.
CoRR
Vamsi Aribandi, Yi Tay, Tal Schuster, Jinfeng Rao, Huaixiu Steven Zheng, Sanket Vaibhav Mehta, Honglei Zhuang, Vinh Q. Tran, Dara Bahri, Jianmo Ni, Jai Prakash Gupta, Kai Hui, Sebastian Ruder, Donald Metzler
2021 J jnl
FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding.
CoRR
Yanan Zheng, Jing Zhou, Yujie Qian, Ming Ding, Jian Li, Ruslan Salakhutdinov, Jie Tang, Sebastian Ruder, Zhilin Yang
2021 — conf
How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models.
ACL/IJCNLP (1)
Phillip Rust, Jonas Pfeiffer, Ivan Vulic, Sebastian Ruder, Iryna Gurevych
2021 — conf
IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation.
EMNLP (1)
Samuel Cahyawijaya, Genta Indra Winata, Bryan Wilie, Karissa Vincentio, Xiaohong Li, Adhiguna Kuncoro, Sebastian Ruder, Zhi Yuan Lim, Syafri Bahar, Masayu Leylia Khodra, Ayu Purwarianti, Pascale Fung
2021 J jnl
IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation.
CoRR
Samuel Cahyawijaya, Genta Indra Winata, Bryan Wilie, Karissa Vincentio, Xiaohong Li, Adhiguna Kuncoro, Sebastian Ruder, Zhi Yuan Lim, Syafri Bahar, Masayu Leylia Khodra, Ayu Purwarianti, Pascale Fung
2021 — conf
LiRo: Benchmark and leaderboard for Romanian language tasks.
NeurIPS Datasets and Benchmarks
Stefan Daniel Dumitrescu, Petru Rebeja, Beáta Lorincz, Mihaela Gaman, Andrei-Marius Avram, Mihai Ilie, Andrei Pruteanu, Adriana Stan, Lorena Rosia, Cristina Iacobescu, Luciana Morogan, George Dima, Gabriel Marchidan, Traian Rebedea, Madalina Chitez, Dani Yogatama, Sebastian Ruder, Radu Tudor Ionescu, Razvan Pascanu, Viorica Patraucean
2021 A* conf
Long Range Arena : A Benchmark for Efficient Transformers.
ICLR
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler
2021 — conf
MAD-G: Multilingual Adapter Generation for Efficient Cross-Lingual Transfer.
EMNLP (Findings)
Alan Ansell, Edoardo Maria Ponti, Jonas Pfeiffer, Sebastian Ruder, Goran Glavas, Ivan Vulic, Anna Korhonen
2021 — conf
MasakhaNER: Named Entity Recognition for African Languages.
AfricaNLP
David Ifeoluwa Adelani, Jade Z. Abbott, Graham Neubig, Daniel D'souza, Julia Kreutzer, Constantine Lignos, Chester Palen-Michel, Happy Buzaaba, Shruti Rijhwani, Sebastian Ruder, Stephen Mayhew, Israel Abebe Azime, Shamsuddeen Hassan Muhammad, Chris Chinenye Emezue, Joyce Nakatumba-Nabende, Perez Ogayo, Aremu Anuoluwapo, Catherine Gitau, Derguene Mbaye, Jesujoba O. Alabi, Seid Muhie Yimam, Tajuddeen Gwadabe, Ignatius Ezeani, Rubungo Andre Niyongabo, Jonathan Mukiibi, Verrah Otiende, Iroro Orife, Davis David, Samba Ngom, Tosin P. Adewumi, Paul Rayson, Mofetoluwa Adeyemi, Gerald Muriuki, Emmanuel Anebi, Chiamaka Chukwuneke, Nkiruka Odu, Eric Peter Wairagala, Samuel Oyerinde, Clemencia Siro, Tobius Saul Bateesa, Temilola Oloyede, Yvonne Wambui, Victor Akinode, Deborah Nabagereka, Maurice Katusiime, Ayodele Awokoya, Mouhamadane Mboup, Dibora Gebreyohannes, Henok Tilaye, Kelechi Nwaike, Degaga Wolde, Abdoulaye Faye, Blessing K. Sibanda, Orevaoghene Ahia, Bonaventure F. P. Dossou, Kelechi Ogueji, Thierno Ibrahima Diop, Abdoulaye Diallo, Adewale Akinfaderin, Tendai Marengereke, Salomey Osei
2021 J jnl
MasakhaNER: Named Entity Recognition for African Languages.
Trans. Assoc. Comput. Linguistics
David Ifeoluwa Adelani, Jade Z. Abbott, Graham Neubig, Daniel D'souza, Julia Kreutzer, Constantine Lignos, Chester Palen-Michel, Happy Buzaaba, Shruti Rijhwani, Sebastian Ruder, Stephen Mayhew, Israel Abebe Azime, Shamsuddeen Hassan Muhammad, Chris Chinenye Emezue, Joyce Nakatumba-Nabende, Perez Ogayo, Aremu Anuoluwapo, Catherine Gitau, Derguene Mbaye, Jesujoba O. Alabi, Seid Muhie Yimam, Tajuddeen Gwadabe, Ignatius Ezeani, Rubungo Andre Niyongabo, Jonathan Mukiibi, Verrah Otiende, Iroro Orife, Davis David, Samba Ngom, Tosin P. Adewumi, Paul Rayson, Mofetoluwa Adeyemi, Gerald Muriuki, Emmanuel Anebi, Chiamaka Chukwuneke, Nkiruka Odu, Eric Peter Wairagala, Samuel Oyerinde, Clemencia Siro, Tobius Saul Bateesa, Temilola Oloyede, Yvonne Wambui, Victor Akinode, Deborah Nabagereka, Maurice Katusiime, Ayodele Awokoya, Mouhamadane Mboup, Dibora Gebreyohannes, Henok Tilaye, Kelechi Nwaike, Degaga Wolde, Abdoulaye Faye, Blessing K. Sibanda, Orevaoghene Ahia, Bonaventure F. P. Dossou, Kelechi Ogueji, Thierno Ibrahima Diop, Abdoulaye Diallo, Adewale Akinfaderin, Tendai Marengereke, Salomey Osei
2021 A* conf
Mind the Gap: Assessing Temporal Generalization in Neural Language Models.
NeurIPS
Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Tomás Kociský, Sebastian Ruder, Dani Yogatama, Kris Cao, Susannah Young, Phil Blunsom
2021 — conf
Multi-Domain Multilingual Question Answering.
EMNLP (Tutorial Abstracts)
Sebastian Ruder, Avi Sil
2021 — conf
Multi-view Subword Regularization.
NAACL-HLT
Xinyi Wang, Sebastian Ruder, Graham Neubig
2021 J jnl
Multi-view Subword Regularization.
CoRR
Xinyi Wang, Sebastian Ruder, Graham Neubig
2021 J jnl
NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation.
CoRR
Kaustubh D. Dhole, Varun Gangal, Sebastian Gehrmann, Aadesh Gupta, Zhenhao Li, Saad Mahamood, Abinaya Mahendiran, Simon Mille, Ashish Srivastava, Samson Tan, Tongshuang Wu, Jascha Sohl-Dickstein, Jinho D. Choi, Eduard H. Hovy, Ondrej Dusek, Sebastian Ruder, Sajant Anand, Nagender Aneja, Rabin Banjade, Lisa Barthe, Hanna Behnke, Ian Berlot-Attwell, Connor Boyle, Caroline Brun, Marco Antonio Sobrevilla Cabezudo, Samuel Cahyawijaya, Emile Chapuis, Wanxiang Che, Mukund Choudhary, Christian Clauss, Pierre Colombo, Filip Cornell, Gautier Dagan, Mayukh Das, Tanay Dixit, Thomas Dopierre, Paul-Alexis Dray, Suchitra Dubey, Tatiana Ekeinhor, Marco Di Giovanni, Tanya Goyal, Rishabh Gupta, Louanes Hamla, Sang Han, Fabrice Harel-Canada, Antoine Honore, Ishan Jindal, Przemyslaw K. Joniak, Denis Kleyko, Venelin Kovatchev, Kalpesh Krishna, Ashutosh Kumar, Stefan Langer, Seungjae Ryan Lee, Corey James Levinson, Hualou Liang, Kaizhao Liang, Zhexiong Liu, Andrey Lukyanenko, Vukosi Marivate, Gerard de Melo, Simon Meoni, Maxime Meyer, Afnan Mir, Nafise Sadat Moosavi, Niklas Muennighoff, Timothy Sum Hon Mun, Kenton Murray, Marcin Namysl, Maria Obedkova, Priti Oli, Nivranshu Pasricha, Jan Pfister, Richard Plant, Vinay Prabhu, Vasile Pais, Libo Qin, Shahab Raji, Pawan Kumar Rajpoot, Vikas Raunak, Roy Rinberg, Nicholas Roberts, Juan Diego Rodriguez, Claude Roux, Paulo Henrique Santos Vasconcellos, Ananya B. Sai, Robin M. Schmidt, Thomas Scialom, Tshephisho Sefara, Saqib Shamsi, Xudong Shen, Yiwen Shi, Haoyue Shi, Anna Shvets, Nick Siegel, Damien Sileo, Jamie Simon, Chandan Singh, Roman Sitelew, Priyank Soni, Taylor Sorensen, William Soto Martinez, Aman Srivastava, KV Aditya Srivatsa, Tony Sun, Mukund Varma T., A. Tabassum, Fiona Anting Tan, Ryan Teehan, Mo Tiwari, Marie Tolkiehn, Athena Wang, Zijian Wang, Zijie J. Wang, Gloria Wang, Fuxuan Wei, Bryan Wilie, Genta Indra Winata, Xinyi Wu, Witold Wydmanski, Tianbao Xie, Usama Yaseen, Michael A. Yee, Jing Zhang, Yue Zhang
2021 — conf
Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks.
ACL/IJCNLP (1)
Rabeeh Karimi Mahabadi, Sebastian Ruder, Mostafa Dehghani, James Henderson
2021 J jnl
Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks.
CoRR
Rabeeh Karimi Mahabadi, Sebastian Ruder, Mostafa Dehghani, James Henderson
2021 J jnl
Pitfalls of Static Language Modelling.
CoRR
Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Sebastian Ruder, Dani Yogatama, Kris Cao, Tomás Kociský, Susannah Young, Phil Blunsom
2021 A* conf
Rethinking Embedding Coupling in Pre-trained Language Models.
ICLR
Hyung Won Chung, Thibault Févry, Henry Tsai, Melvin Johnson, Sebastian Ruder
2021 — conf
UNKs Everywhere: Adapting Multilingual Language Models to New Scripts.
EMNLP (1)
Jonas Pfeiffer, Ivan Vulic, Iryna Gurevych, Sebastian Ruder
2021 — conf
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation.
EMNLP (1)
Sebastian Ruder, Noah Constant, Jan A. Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Dan Garrette, Graham Neubig, Melvin Johnson
2021 J jnl
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation.
CoRR
Sebastian Ruder, Noah Constant, Jan A. Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Graham Neubig, Melvin Johnson
2020 A* conf
A Call for More Rigor in Unsupervised Cross-lingual Learning.
ACL
Mikel Artetxe, Sebastian Ruder, Dani Yogatama, Gorka Labaka, Eneko Agirre
2020 J jnl
A Call for More Rigor in Unsupervised Cross-lingual Learning.
CoRR
Mikel Artetxe, Sebastian Ruder, Dani Yogatama, Gorka Labaka, Eneko Agirre
2020 — conf
AdapterHub: A Framework for Adapting Transformers.
EMNLP (Demos)
Jonas Pfeiffer, Andreas Rücklé, Clifton Poth, Aishwarya Kamath, Ivan Vulic, Sebastian Ruder, Kyunghyun Cho, Iryna Gurevych
2020 J jnl
AdapterHub: A Framework for Adapting Transformers.
CoRR
Jonas Pfeiffer, Andreas Rücklé, Clifton Poth, Aishwarya Kamath, Ivan Vulic, Sebastian Ruder, Kyunghyun Cho, Iryna Gurevych
2020 — conf
Are All Good Word Vector Spaces Isomorphic?
EMNLP (1)
Ivan Vulic, Sebastian Ruder, Anders Søgaard
2020 J jnl
Are All Good Word Vector Spaces Isomorphic?
CoRR
Ivan Vulic, Sebastian Ruder, Anders Søgaard
2020 — conf
AxCell: Automatic Extraction of Results from Machine Learning Papers.
EMNLP (1)
Marcin Kardas, Piotr Czapla, Pontus Stenetorp, Sebastian Ruder, Sebastian Riedel, Ross Taylor, Robert Stojnic
2020 J jnl
AxCell: Automatic Extraction of Results from Machine Learning Papers.
CoRR
Marcin Kardas, Piotr Czapla, Pontus Stenetorp, Sebastian Ruder, Sebastian Riedel, Ross Taylor, Robert Stojnic
2020 J jnl
How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models.
CoRR
Phillip Rust, Jonas Pfeiffer, Ivan Vulic, Sebastian Ruder, Iryna Gurevych
2020 J jnl
Long Range Arena: A Benchmark for Efficient Transformers.
CoRR
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler
2020 — conf
MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer.
EMNLP (1)
Jonas Pfeiffer, Ivan Vulic, Iryna Gurevych, Sebastian Ruder
2020 J jnl
MAD-X: An Adapter-based Framework for Multi-task Cross-lingual Transfer.
CoRR
Jonas Pfeiffer, Ivan Vulic, Iryna Gurevych, Sebastian Ruder
2020 B conf
Morphologically Aware Word-Level Translation.
COLING
Paula Czarnowska, Sebastian Ruder, Ryan Cotterell, Ann A. Copestake
2020 J jnl
Morphologically Aware Word-Level Translation.
CoRR
Paula Czarnowska, Sebastian Ruder, Ryan Cotterell, Ann A. Copestake
2020 A* conf
On the Cross-lingual Transferability of Monolingual Representations.
ACL
Mikel Artetxe, Sebastian Ruder, Dani Yogatama
2020 J jnl
Rethinking embedding coupling in pre-trained language models.
CoRR
Hyung Won Chung, Thibault Févry, Henry Tsai, Melvin Johnson, Sebastian Ruder
2020 J jnl
UNKs Everywhere: Adapting Multilingual Language Models to New Scripts.
CoRR
Jonas Pfeiffer, Ivan Vulic, Iryna Gurevych, Sebastian Ruder
2020 A* conf
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation.
ICML
Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, Melvin Johnson
2020 J jnl
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization.
CoRR
Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, Melvin Johnson
2019 A* conf
A Hierarchical Multi-Task Approach for Learning Embeddings from Semantic Tasks.
AAAI
Victor Sanh, Thomas Wolf, Sebastian Ruder
2019 J jnl
A Survey of Cross-lingual Word Embedding Models.
J. Artif. Intell. Res.
Sebastian Ruder, Ivan Vulic, Anders Søgaard
2019 — book
Cross-Lingual Word Embeddings
Anders Søgaard, Ivan Vulic, Sebastian Ruder, Manaal Faruqui
2019 — conf
Don't Forget the Long Tail! A Comprehensive Analysis of Morphological Generalization in Bilingual Lexicon Induction.
EMNLP/IJCNLP (1)
Paula Czarnowska, Sebastian Ruder, Edouard Grave, Ryan Cotterell, Ann A. Copestake
2019 J jnl
Don't Forget the Long Tail! A Comprehensive Analysis of Morphological Generalization in Bilingual Lexicon Induction.
CoRR
Paula Czarnowska, Sebastian Ruder, Edouard Grave, Ryan Cotterell, Ann A. Copestake
2019 A* conf
Episodic Memory in Lifelong Language Learning.
NeurIPS
Cyprien de Masson d'Autume, Sebastian Ruder, Lingpeng Kong, Dani Yogatama
2019 J jnl
Episodic Memory in Lifelong Language Learning.
CoRR
Cyprien de Masson d'Autume, Sebastian Ruder, Lingpeng Kong, Dani Yogatama
2019 — conf
How to (Properly) Evaluate Cross-Lingual Word Embeddings: On Strong Baselines, Comparative Analyses, and Some Misconceptions.
ACL (1)
Goran Glavas, Robert Litschko, Sebastian Ruder, Ivan Vulic
2019 J jnl
How to (Properly) Evaluate Cross-Lingual Word Embeddings: On Strong Baselines, Comparative Analyses, and Some Misconceptions.
CoRR
Goran Glavas, Robert Litschko, Sebastian Ruder, Ivan Vulic
2019 A* conf
Latent Multi-Task Architecture Learning.
AAAI
Sebastian Ruder, Joachim Bingel, Isabelle Augenstein, Anders Søgaard
2019 — conf
MultiFiT: Efficient Multi-lingual Language Model Fine-tuning.
EMNLP/IJCNLP (1)
Julian Eisenschlos, Sebastian Ruder, Piotr Czapla, Marcin Kardas, Sylvain Gugger, Jeremy Howard
2019 J jnl
MultiFiT: Efficient Multi-lingual Language Model Fine-tuning.
CoRR
Julian Eisenschlos, Sebastian Ruder, Piotr Czapla, Marcin Kardas, Sylvain Gugger, Jeremy Howard
2019 J jnl
On the Cross-lingual Transferability of Monolingual Representations.
CoRR
Mikel Artetxe, Sebastian Ruder, Dani Yogatama
2019 — ed.
Proceedings of the 4th Workshop on Representation Learning for NLP, RepL4NLP@ACL 2019, Florence, Italy, August 2, 2019.
RepL4NLP@ACL
Isabelle Augenstein, Spandana Gella, Sebastian Ruder, Katharina Kann, Burcu Can, Johannes Welbl, Alexis Conneau, Xiang Ren, Marek Rei
2019 — conf
To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks.
RepL4NLP@ACL
Matthew E. Peters, Sebastian Ruder, Noah A. Smith
2019 J jnl
To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks.
CoRR
Matthew E. Peters, Sebastian Ruder, Noah A. Smith
2019 — conf
Transfer Learning in Natural Language Processing.
NAACL-HLT (Tutorial Abstracts)
Sebastian Ruder, Matthew E. Peters, Swabha Swayamdipta, Thomas Wolf
2019 — conf
Unsupervised Cross-Lingual Representation Learning.
ACL (4)
Sebastian Ruder, Anders Søgaard, Ivan Vulic
2019 J jnl
What do Deep Networks Like to Read?
CoRR
Jonas Pfeiffer, Aishwarya Kamath, Iryna Gurevych, Sebastian Ruder
2018 — conf
360° Stance Detection.
NAACL-HLT (Demonstrations)
Sebastian Ruder, John Glover, Afshin Mehrabani, Parsa Ghaffari
2018 J jnl
360° Stance Detection.
CoRR
Sebastian Ruder, John Glover, Afshin Mehrabani, Parsa Ghaffari
2018 A* conf
A Discriminative Latent-Variable Model for Bilingual Lexicon Induction.
EMNLP
Sebastian Ruder, Ryan Cotterell, Yova Kementchedjhieva, Anders Søgaard
2018 J jnl
A Discriminative Latent-Variable Model for Bilingual Lexicon Induction.
CoRR
Sebastian Ruder, Ryan Cotterell, Yova Kementchedjhieva, Anders Søgaard
2018 J jnl
A Hierarchical Multi-task Approach for Learning Embeddings from Semantic Tasks.
CoRR
Victor Sanh, Thomas Wolf, Sebastian Ruder
2018 J jnl
Fine-tuned Language Models for Text Classification.
CoRR
Jeremy Howard, Sebastian Ruder
2018 B conf
Generalizing Procrustes Analysis for Better Bilingual Dictionary Induction.
CoNLL
Yova Kementchedjhieva, Sebastian Ruder, Ryan Cotterell, Anders Søgaard
2018 J jnl
Generalizing Procrustes Analysis for Better Bilingual Dictionary Induction.
CoRR
Yova Kementchedjhieva, Sebastian Ruder, Ryan Cotterell, Anders Søgaard
2018 — conf
Multi-Task Learning of Pairwise Sequence Classification Tasks over Disparate Label Spaces.
NAACL-HLT
Isabelle Augenstein, Sebastian Ruder, Anders Søgaard
2018 J jnl
Multi-task Learning of Pairwise Sequence Classification Tasks Over Disparate Label Spaces.
CoRR
Isabelle Augenstein, Sebastian Ruder, Anders Søgaard
2018 J jnl
Off-the-Shelf Unsupervised NMT.
CoRR
Chris Hokamp, Sebastian Ruder, John Glover
2018 — conf
On the Limitations of Unsupervised Bilingual Dictionary Induction.
ACL (1)
Anders Søgaard, Sebastian Ruder, Ivan Vulic
2018 J jnl
On the Limitations of Unsupervised Bilingual Dictionary Induction.
CoRR
Anders Søgaard, Sebastian Ruder, Ivan Vulic
2018 — conf
Strong Baselines for Neural Semi-Supervised Learning under Domain Shift.
ACL (1)
Sebastian Ruder, Barbara Plank
2018 J jnl
Strong Baselines for Neural Semi-supervised Learning under Domain Shift.
CoRR
Sebastian Ruder, Barbara Plank
2018 — conf
Universal Language Model Fine-tuning for Text Classification.
ACL (1)
Jeremy Howard, Sebastian Ruder
2017 J jnl
A survey of cross-lingual embedding models.
CoRR
Sebastian Ruder
2017 J jnl
An Overview of Multi-Task Learning in Deep Neural Networks.
CoRR
Sebastian Ruder
2017 J jnl
Data Selection Strategies for Multi-Domain Sentiment Analysis.
CoRR
Sebastian Ruder, Parsa Ghaffari, John G. Breslin
2017 J jnl
Knowledge Adaptation: Teaching to Adapt.
CoRR
Sebastian Ruder, Parsa Ghaffari, John G. Breslin
2017 A* conf
Learning to select data for transfer learning with Bayesian Optimization.
EMNLP
Sebastian Ruder, Barbara Plank
2017 J jnl
Learning to select data for transfer learning with Bayesian Optimization.
CoRR
Sebastian Ruder, Barbara Plank
2017 J jnl
Sluice networks: Learning what to share between loosely related tasks.
CoRR
Sebastian Ruder, Joachim Bingel, Isabelle Augenstein, Anders Søgaard
2016 A* conf
A Hierarchical Model of Reviews for Aspect-based Sentiment Analysis.
EMNLP
Sebastian Ruder, Parsa Ghaffari, John G. Breslin
2016 J jnl
A Hierarchical Model of Reviews for Aspect-based Sentiment Analysis.
CoRR
Sebastian Ruder, Parsa Ghaffari, John G. Breslin
2016 J jnl
An overview of gradient descent optimization algorithms.
CoRR
Sebastian Ruder
2016 J jnl
Character-level and Multi-channel Convolutional Neural Networks for Large-scale Authorship Attribution.
CoRR
Sebastian Ruder, Parsa Ghaffari, John G. Breslin
2016 — conf
INSIGHT-1 at SemEval-2016 Task 4: Convolutional Neural Networks for Sentiment Classification and Quantification.
SemEval@NAACL-HLT
Sebastian Ruder, Parsa Ghaffari, John G. Breslin
2016 J jnl
INSIGHT-1 at SemEval-2016 Task 4: Convolutional Neural Networks for Sentiment Classification and Quantification.
CoRR
Sebastian Ruder, Parsa Ghaffari, John G. Breslin
2016 — conf
INSIGHT-1 at SemEval-2016 Task 5: Deep Learning for Multilingual Aspect-based Sentiment Analysis.
SemEval@NAACL-HLT
Sebastian Ruder, Parsa Ghaffari, John G. Breslin
2016 J jnl
INSIGHT-1 at SemEval-2016 Task 5: Deep Learning for Multilingual Aspect-based Sentiment Analysis.
CoRR
Sebastian Ruder, Parsa Ghaffari, John G. Breslin
2016 J jnl
Towards a continuous modeling of natural language domains.
CoRR
Sebastian Ruder, Parsa Ghaffari, John G. Breslin