Tristan Thrush

43 papers A* 8B 1Journal 23Unranked 11
YearRankTypeTitle / Venue / Authors
2025 A* conf
Improving Pretraining Data Using Perplexity Correlations.
ICLR
Tristan Thrush, Christopher Potts, Tatsunori Hashimoto
2025 A* conf
MixMin: Finding Data Mixtures via Convex Minimization.
ICML
Anvith Thudi, Evianne Rovers, Yangjun Ruan, Tristan Thrush, Chris J. Maddison
2025 J jnl
MixMin: Finding Data Mixtures via Convex Minimization.
CoRR
Anvith Thudi, Evianne Rovers, Yangjun Ruan, Tristan Thrush, Chris J. Maddison
2024 — conf
ColorSwap: A Color and Word Order Dataset for Multimodal Evaluation.
ACL (Findings)
Jirayu Burapacheep, Ishan Gaur, Agam Bhatia, Tristan Thrush
2024 J jnl
ColorSwap: A Color and Word Order Dataset for Multimodal Evaluation.
CoRR
Jirayu Burapacheep, Ishan Gaur, Agam Bhatia, Tristan Thrush
2024 — conf
I am a Strange Dataset: Metalinguistic Tests for Language Models.
ACL (1)
Tristan Thrush, Jared Moore, Miguel Monares, Christopher Potts, Douwe Kiela
2024 J jnl
I am a Strange Dataset: Metalinguistic Tests for Language Models.
CoRR
Tristan Thrush, Jared Moore, Miguel Monares, Christopher Potts, Douwe Kiela
2024 J jnl
Improving Pretraining Data Using Perplexity Correlations.
CoRR
Tristan Thrush, Christopher Potts, Tatsunori Hashimoto
2024 A* conf
Nearest Neighbor Normalization Improves Multimodal Retrieval.
EMNLP
Neil Chowdhury, Franklin Wang, Sumedh Shenoy, Douwe Kiela, Sarah Schwettmann, Tristan Thrush
2024 J jnl
Nearest Neighbor Normalization Improves Multimodal Retrieval.
CoRR
Neil Chowdhury, Franklin Wang, Sumedh Shenoy, Douwe Kiela, Sarah Schwettmann, Tristan Thrush
2023 A* conf
DataPerf: Benchmarks for Data-Centric AI Development.
NeurIPS
Mark Mazumder, Colby R. Banbury, Xiaozhe Yao, Bojan Karlas, William Gaviria Rojas, Sudnya Frederick Diamos, Greg Diamos, Lynn He, Alicia Parrish, Hannah Rose Kirk, Jessica Quaye, Charvi Rastogi, Douwe Kiela, David Jurado, David Kanter, Rafael Mosquera, Will Cukierski, Juan Ciro, Lora Aroyo, Bilge Acun, Lingjiao Chen, Mehul Raje, Max Bartolo, Evan Sabri Eyuboglu, Amirata Ghorbani, Emmett D. Goodman, Addison Howard, Oana Inel, Tariq Kane, Christine R. Kirkpatrick, D. Sculley, Tzu-Sheng Kuo, Jonas W. Mueller, Tristan Thrush, Joaquin Vanschoren, Margaret Warren, Adina Williams, Serena Yeung, Newsha Ardalani, Praveen K. Paritosh, Ce Zhang, James Y. Zou, Carole-Jean Wu, Cody Coleman, Andrew Y. Ng, Peter Mattson, Vijay Janapa Reddi
2023 J jnl
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset.
CoRR
Hugo Laurençon, Lucile Saulnier, Thomas Wang, Christopher Akiki, Albert Villanova del Moral, Teven Le Scao, Leandro von Werra, Chenghao Mou, Eduardo González Ponferrada, Huu Nguyen, Jörg Frohberg, Mario Sasko, Quentin Lhoest, Angelina McMillan-Major, Gérard Dupont, Stella Biderman, Anna Rogers, Loubna Ben Allal, Francesco De Toni, Giada Pistilli, Olivier Nguyen, Somaieh Nikpoor, Maraim Masoud, Pierre Colombo, Javier de la Rosa, Paulo Villegas, Tristan Thrush, Shayne Longpre, Sebastian Nagel, Leon Weber, Manuel Muñoz, Jian Zhu, Daniel van Strien, Zaid Alyafeai, Khalid Almubarak, Minh Chien Vu, Itziar Gonzalez-Dios, Aitor Soroa, Kyle Lo, Manan Dey, Pedro Ortiz Suarez, Aaron Gokaslan, Shamik Bose, David Ifeoluwa Adelani, Long Phan, Hieu Tran, Ian Yu, Suhas Pai, Jenny Chim, Violette Lepercq, Suzana Ilic, Margaret Mitchell, Sasha Luccioni, Yacine Jernite
2023 J jnl
Towards Language Models That Can See: Computer Vision Through the LENS of Natural Language.
CoRR
William Berrios, Gautam Mittal, Tristan Thrush, Douwe Kiela, Amanpreet Singh
2022 J jnl
DataPerf: Benchmarks for Data-Centric AI Development.
CoRR
Mark Mazumder, Colby R. Banbury, Xiaozhe Yao, Bojan Karlas, William Gaviria Rojas, Sudnya Frederick Diamos, Greg Diamos, Lynn He, Douwe Kiela, David Jurado, David Kanter, Rafael Mosquera, Juan Ciro, Lora Aroyo, Bilge Acun, Sabri Eyuboglu, Amirata Ghorbani, Emmett D. Goodman, Tariq Kane, Christine R. Kirkpatrick, Tzu-Sheng Kuo, Jonas Mueller, Tristan Thrush, Joaquin Vanschoren, Margaret Warren, Adina Williams, Serena Yeung, Newsha Ardalani, Praveen K. Paritosh, Ce Zhang, James Zou, Carole-Jean Wu, Cody Coleman, Andrew Y. Ng, Peter Mattson, Vijay Janapa Reddi
2022 — conf
Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks.
ACL (demo)
Tristan Thrush, Kushal Tirumala, Anmol Gupta, Max Bartolo, Pedro Rodriguez, Tariq Kane, William Gaviria Rojas, Peter Mattson, Adina Williams, Douwe Kiela
2022 J jnl
Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks.
CoRR
Tristan Thrush, Kushal Tirumala, Anmol Gupta, Max Bartolo, Pedro Rodriguez, Tariq Kane, William Gaviria Rojas, Peter Mattson, Adina Williams, Douwe Kiela
2022 — conf
Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements.
EMNLP (Demos)
Leandro von Werra, Lewis Tunstall, Abhishek Thakur, Sasha Luccioni, Tristan Thrush, Aleksandra Piktus, Felix Marty, Nazneen Rajani, Victor Mustar, Helen Ngo
2022 J jnl
Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements.
CoRR
Leandro von Werra, Lewis Tunstall, Abhishek Thakur, Alexandra Sasha Luccioni, Tristan Thrush, Aleksandra Piktus, Felix Marty, Nazneen Rajani, Victor Mustar, Helen Ngo, Omar Sanseviero, Mario Sasko, Albert Villanova del Moral, Quentin Lhoest, Julien Chaumond, Margaret Mitchell, Alexander M. Rush, Thomas Wolf, Douwe Kiela
2022 — conf
Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-Based Hate.
NAACL-HLT
Hannah Kirk, Bertie Vidgen, Paul Röttger, Tristan Thrush, Scott Hale
2022 J jnl
Measuring Data.
CoRR
Margaret Mitchell, Alexandra Sasha Luccioni, Nathan Lambert, Marissa Gerchick, Angelina McMillan-Major, Ezinwanne Ozoani, Nazneen Rajani, Tristan Thrush, Yacine Jernite, Douwe Kiela
2022 — conf
Models in the Loop: Aiding Crowdworkers with Generative Annotation Assistants.
NAACL-HLT
Max Bartolo, Tristan Thrush, Sebastian Riedel, Pontus Stenetorp, Robin Jia, Douwe Kiela
2022 A* conf
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset.
NeurIPS
Hugo Laurençon, Lucile Saulnier, Thomas Wang, Christopher Akiki, Albert Villanova del Moral, Teven Le Scao, Leandro von Werra, Chenghao Mou, Eduardo González Ponferrada, Huu Nguyen, Jörg Frohberg, Mario Sasko, Quentin Lhoest, Angelina McMillan-Major, Gérard Dupont, Stella Biderman, Anna Rogers, Loubna Ben Allal, Francesco De Toni, Giada Pistilli, Olivier Nguyen, Somaieh Nikpoor, Maraim Masoud, Pierre Colombo, Javier de la Rosa, Paulo Villegas, Tristan Thrush, Shayne Longpre, Sebastian Nagel, Leon Weber, Manuel Muñoz, Jian Zhu, Daniel van Strien, Zaid Alyafeai, Khalid Almubarak, Minh Chien Vu, Itziar Gonzalez-Dios, Aitor Soroa, Kyle Lo, Manan Dey, Pedro Ortiz Suarez, Aaron Gokaslan, Shamik Bose, David Ifeoluwa Adelani, Long Phan, Hieu Tran, Ian Yu, Suhas Pai, Jenny Chim, Violette Lepercq, Suzana Ilic, Margaret Mitchell, Alexandra Sasha Luccioni, Yacine Jernite
2022 A* conf
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality.
CVPR
Tristan Thrush, Ryan Jiang, Max Bartolo, Amanpreet Singh, Adina Williams, Douwe Kiela, Candace Ross
2022 J jnl
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality.
CoRR
Tristan Thrush, Ryan Jiang, Max Bartolo, Amanpreet Singh, Adina Williams, Douwe Kiela, Candace Ross
2021 — conf
Dynabench: Rethinking Benchmarking in NLP.
NAACL-HLT
Douwe Kiela, Max Bartolo, Yixin Nie, Divyansh Kaushik, Atticus Geiger, Zhengxuan Wu, Bertie Vidgen, Grusha Prasad, Amanpreet Singh, Pratik Ringshia, Zhiyi Ma, Tristan Thrush, Sebastian Riedel, Zeerak Waseem, Pontus Stenetorp, Robin Jia, Mohit Bansal, Christopher Potts, Adina Williams
2021 J jnl
Dynabench: Rethinking Benchmarking in NLP.
CoRR
Douwe Kiela, Max Bartolo, Yixin Nie, Divyansh Kaushik, Atticus Geiger, Zhengxuan Wu, Bertie Vidgen, Grusha Prasad, Amanpreet Singh, Pratik Ringshia, Zhiyi Ma, Tristan Thrush, Sebastian Riedel, Zeerak Waseem, Pontus Stenetorp, Robin Jia, Mohit Bansal, Christopher Potts, Adina Williams
2021 A* conf
Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking.
NeurIPS
Zhiyi Ma, Kawin Ethayarajh, Tristan Thrush, Somya Jain, Ledell Wu, Robin Jia, Christopher Potts, Adina Williams, Douwe Kiela
2021 J jnl
Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking.
CoRR
Zhiyi Ma, Kawin Ethayarajh, Tristan Thrush, Somya Jain, Ledell Wu, Robin Jia, Christopher Potts, Adina Williams, Douwe Kiela
2021 — conf
Findings of the WMT 2021 Shared Task on Large-Scale Multilingual Machine Translation.
WMT@EMNLP
Guillaume Wenzek, Vishrav Chaudhary, Angela Fan, Sahir Gomez, Naman Goyal, Somya Jain, Douwe Kiela, Tristan Thrush, Francisco Guzmán
2021 J jnl
Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-based Hate.
CoRR
Hannah Rose Kirk, Bertram Vidgen, Paul Röttger, Tristan Thrush, Scott Hale
2021 A* conf
Human-Adversarial Visual Question Answering.
NeurIPS
Sasha Sheng, Amanpreet Singh, Vedanuj Goswami, Jose Alberto Lopez Magana, Tristan Thrush, Wojciech Galuba, Devi Parikh, Douwe Kiela
2021 — conf
Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation.
EMNLP (1)
Max Bartolo, Tristan Thrush, Robin Jia, Sebastian Riedel, Pontus Stenetorp, Douwe Kiela
2021 J jnl
Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation.
CoRR
Max Bartolo, Tristan Thrush, Robin Jia, Sebastian Riedel, Pontus Stenetorp, Douwe Kiela
2021 — conf
Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detection.
ACL/IJCNLP (1)
Bertie Vidgen, Tristan Thrush, Zeerak Waseem, Douwe Kiela
2021 J jnl
Models in the Loop: Aiding Crowdworkers with Generative Annotation Assistants.
CoRR
Max Bartolo, Tristan Thrush, Sebastian Riedel, Pontus Stenetorp, Robin Jia, Douwe Kiela
2021 J jnl
Rover Relocalization for Mars Sample Return by Virtual Template Synthesis and Matching.
CoRR
Tu-Hoa Pham, William Seto, Shreyansh Daftry, Barry Ridge, Johanna Hansen, Tristan Thrush, Mark Van der Merwe, Gerard Maggiolino, Alexander Brinkman, John Mayo, Yang Cheng, Curtis Padgett, Eric A. Kulczycki, Renaud Detry
2021 J jnl
Rover Relocalization for Mars Sample Return by Virtual Template Synthesis and Matching.
IEEE Robotics Autom. Lett.
Tu-Hoa Pham, William Seto, Shreyansh Daftry, Barry Ridge, Johanna Hansen, Tristan Thrush, Mark Van der Merwe, Gerard Maggiolino, Alexander Brinkman, John Mayo, Yang Cheng, Curtis Padgett, Eric A. Kulczycki, Renaud Detry
2020 J jnl
ANLIzing the Adversarial Natural Language Inference Dataset.
CoRR
Adina Williams, Tristan Thrush, Douwe Kiela
2020 B conf
Compositional Neural Machine Translation by Removing the Lexicon from Syntax.
CogSci
Tristan Thrush
2020 J jnl
Compositional Neural Machine Translation by Removing the Lexicon from Syntax.
CoRR
Tristan Thrush
2020 — conf
Investigating Novel Verb Learning in BERT: Selectional Preference Classes and Alternation-Based Syntactic Generalization.
BlackboxNLP@EMNLP
Tristan Thrush, Ethan Wilcox, Roger Levy
2020 J jnl
Investigating Novel Verb Learning in BERT: Selectional Preference Classes and Alternation-Based Syntactic Generalization.
CoRR
Tristan Thrush, Ethan Wilcox, Roger Levy
2020 J jnl
Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detection.
CoRR
Bertie Vidgen, Tristan Thrush, Zeerak Waseem, Douwe Kiela