Paul Röttger

76 papers A* 10Journal 45Unranked 21
YearRankTypeTitle / Venue / Authors
2026 — conf
Bias in the East, Bias in the West: A Bilingual Analysis of LLM Political Bias on U.S.- and China-Related Issues.
EACL (Findings)
Ying Ying Lim, Paul Röttger
2026 J jnl
Diffusion Language Models Are Natively Length-Aware.
CoRR
Vittorio Rossi, Giacomo Cirò, Davide Beltrame, Luca Gandolfi, Paul Röttger, Dirk Hovy
2026 J jnl
IssueBench: Millions of Realistic Prompts for Measuring Issue Bias in LLM Writing Assistance.
Trans. Assoc. Comput. Linguistics
Paul Röttger, Musashi Hinck, Valentin Hofmann, Kobi Hackenburg, Valentina Pyatkin, Faeze Brahman, Dirk Hovy
2026 — conf
The Pluralistic Moral Gap: Understanding Moral Judgment and Value Differences between Humans and Large Language Models.
EACL (Volume 1: Long Papers)
Giuseppe Russo, Debora Nozza, Paul Röttger, Dirk Hovy
2025 J jnl
AILuminate: Introducing v1.0 of the AI Risk and Reliability Benchmark from MLCommons.
CoRR
Shaona Ghosh, Heather Frase, Adina Williams, Sarah Luger, Paul Röttger, Fazl Barez, Sean McGregor, Kenneth Fricklas, Mala Kumar, Quentin Feuillade-Montixi, Kurt D. Bollacker, Felix Friedrich, Ryan Tsang, Bertie Vidgen, Alicia Parrish, Chris Knotz, Eleonora Presani, Jonathan Bennion, Marisa Ferrara Boston, Mike Kuniavsky, Wiebke Hutiri, James Ezick, Malek Ben Salem, Rajat Sahay, Sujata S. Goswami, Usman Gohar, Ben Huang, Supheakmungkol Sarin, Elie Alhajjar, Canyu Chen, Roman Eng, Kashyap Ramanandula Manjusha, Virendra Mehta, Eileen Long, Murali Emani, Natan Vidra, Benjamin Rukundo, Abolfazl Shahbazi, Kongtao Chen, Rajat Ghosh, Vithursan Thangarasa, Pierre Peigné, Abhinav Singh, Max Bartolo, Satyapriya Krishna, Mubashara Akhtar, Rafael Gold, Cody Coleman, Luis Oala, Vassil Tashev, Joseph Marvin Imperial, Amy Russ, Sasidhar Kunapuli, Nicolas Miailhe, Julien Delaunay, Bhaktipriya Radharapu, Rajat Shinde, Tuesday, Debojyoti Dutta, Declan Grabb, Ananya Gangavarapu, Saurav Sahay, Agasthya Gangavarapu, Patrick Schramowski, Stephen Singam, Tom David, Xudong Han, Priyanka Mary Mammen, Tarunima Prabhakar, Venelin Kovatchev, Ahmed Ahmed, Kelvin N. Manyeki, Sandeep Madireddy, Foutse Khomh, Fedor Zhdanov, Joachim Baumann, Nina Vasan, Xianjun Yang, Carlos Mougn, Jibin Rajan Varghese, Hussain Chinoy, Seshakrishna Jitendar, Manil Maskey, Claire V. Hardgrove, Tianhao Li, Aakash Gupta, Emil Joswin, Yifan Mai, Shachi H. Kumar, Cigdem Patlak, Kevin Lu, Vincent Alessi, Sree Bhargavi Balija, Chenhe Gu, Robert Sullivan, James Gealy, Matt Lavrisa, James Goel, Peter Mattson, Percy Liang, Joaquin Vanschoren
2025 — conf
AfriHate: A Multilingual Collection of Hate Speech and Abusive Language Datasets for African Languages.
NAACL (Long Papers)
Shamsuddeen Hassan Muhammad, Idris Abdulmumin, Abinew Ali Ayele, David Ifeoluwa Adelani, Ibrahim Said Ahmad, Saminu Mohammad Aliyu, Paul Röttger, Abigail Oppong, Andiswa Bukula, Chiamaka Ijeoma Chukwuneke, Ebrahim Chekol Jibril, Elyas Abdi Ismail, Esubalew Alemneh, Hagos Tesfahun Gebremichael, Lukman Jibril Aliyu, Meriem Beloucif, Oumaima Hourrane, Rooweither Mabuya, Salomey Osei, Samuel Rutunda, Tadesse Destaw Belay, Tadesse Kebede Guge, Tesfa Tegegne Asfaw, Lilian Diana Awuor Wanzare, Nelson Odhiambo Onyango, Seid Muhie Yimam, Nedjma Ousidhoum
2025 J jnl
AfriHate: A Multilingual Collection of Hate Speech and Abusive Language Datasets for African Languages.
CoRR
Shamsuddeen Hassan Muhammad, Idris Abdulmumin, Abinew Ali Ayele, David Ifeoluwa Adelani, Ibrahim Said Ahmad, Saminu Mohammad Aliyu, Nelson Odhiambo Onyango, Lilian Diana Awuor Wanzare, Samuel Rutunda, Lukman Jibril Aliyu, Esubalew Alemneh, Oumaima Hourrane, Hagos Tesfahun Gebremichael, Elyas Abdi Ismail, Meriem Beloucif, Ebrahim Chekol Jibril, Andiswa Bukula, Rooweither Mabuya, Salomey Osei, Abigail Oppong, Tadesse Destaw Belay, Tadesse Kebede Guge, Tesfa Tegegne Asfaw, Chiamaka Ijeoma Chukwuneke, Paul Röttger, Seid Muhie Yimam, Nedjma Ousidhoum
2025 — conf
Around the World in 24 Hours: Probing LLM Knowledge of Time and Place.
ACL (1)
Carolin Holtermann, Paul Röttger, Anne Lauscher
2025 J jnl
Around the World in 24 Hours: Probing LLM Knowledge of Time and Place.
CoRR
Carolin Holtermann, Paul Röttger, Anne Lauscher
2025 — conf
Beyond Demographics: Fine-tuning Large Language Models to Predict Individuals' Subjective Text Perceptions.
ACL (1)
Matthias Orlikowski, Jiaxin Pei, Paul Röttger, Philipp Cimiano, David Jurgens, Dirk Hovy
2025 J jnl
Beyond Demographics: Fine-tuning Large Language Models to Predict Individuals' Subjective Text Perceptions.
CoRR
Matthias Orlikowski, Jiaxin Pei, Paul Röttger, Philipp Cimiano, David Jurgens, Dirk Hovy
2025 — conf
HateDay: Insights from a Global Hate Speech Dataset Representative of a Day on Twitter.
ACL (1)
Manuel Tonneau, Diyi Liu, Niyati Malhotra, Scott A. Hale, Samuel Fraiberger, Víctor Orozco-Olvera, Paul Röttger
2025 J jnl
IssueBench: Millions of Realistic Prompts for Measuring Issue Bias in LLM Writing Assistance.
CoRR
Paul Röttger, Musashi Hinck, Valentin Hofmann, Kobi Hackenburg, Valentina Pyatkin, Faeze Brahman, Dirk Hovy
2025 J jnl
Large Language Model Hacking: Quantifying the Hidden Risks of Using LLMs for Text Annotation.
CoRR
Joachim Baumann, Paul Röttger, Aleksandra Urman, Albert Wendsjö, Flor Miriam Plaza del Arco, Johannes B. Gruber, Dirk Hovy
2025 J jnl
MSTS: A Multimodal Safety Test Suite for Vision-Language Models.
CoRR
Paul Röttger, Giuseppe Attanasio, Felix Friedrich, Janis Goldzycher, Alicia Parrish, Rishabh Bhardwaj, Chiara Di Bonaventura, Roman Eng, Gaia El Khoury Geagea, Subhra S. Goswami, Jieun Han, Dirk Hovy, Seogyeong Jeong, Paloma Jeretic, Flor Miriam Plaza del Arco, Donya Rooein, Patrick Schramowski, Anastassia Shaitarova, Xudong Shen, Richard Willats, Andrea Zugarini, Bertie Vidgen
2025 J jnl
No for Some, Yes for Others: Persona Prompts and Other Sources of False Refusal in Language Models.
CoRR
Flor Miriam Plaza del Arco, Paul Röttger, Nino Scherrer, Emanuele Borgonovo, Elmar Plischke, Dirk Hovy
2025 A* conf
Personalization up to a Point: Why Personalized Content Moderation Needs Boundaries, and How We Can Enforce Them.
EMNLP
Emanuele Moscato, Tiancheng Hu, Matthias Orlikowski, Paul Röttger, Debora Nozza
2025 A* conf
Principled Personas: Defining and Measuring the Intended Effects of Persona Prompting on Task Performance.
EMNLP
Pedro Henrique Luz de Araujo, Paul Röttger, Dirk Hovy, Benjamin Roth
2025 J jnl
Principled Personas: Defining and Measuring the Intended Effects of Persona Prompting on Task Performance.
CoRR
Pedro Henrique Luz de Araujo, Paul Röttger, Dirk Hovy, Benjamin Roth
2025 A* conf
SafetyPrompts: A Systematic Review of Open Datasets for Evaluating and Improving Large Language Model Safety.
AAAI
Paul Röttger, Fabio Pernisi, Bertie Vidgen, Dirk Hovy
2025 J jnl
SimBench: Benchmarking the Ability of Large Language Models to Simulate Human Behaviors.
CoRR
Tiancheng Hu, Joachim Baumann, Lorenzo Lupo, Nigel Collier, Dirk Hovy, Paul Röttger
2025 — conf
Specializing Large Language Models to Simulate Survey Response Distributions for Global Populations.
NAACL (Long Papers)
Yong Cao, Haijiang Liu, Arnav Arora, Isabelle Augenstein, Paul Röttger, Daniel Hershcovich
2025 J jnl
Specializing Large Language Models to Simulate Survey Response Distributions for Global Populations.
CoRR
Yong Cao, Haijiang Liu, Arnav Arora, Isabelle Augenstein, Paul Röttger, Daniel Hershcovich
2025 A* conf
Surgical, Cheap, and Flexible: Mitigating False Refusal in Language Models via Single Vector Ablation.
ICLR
Xinpeng Wang, Chengzhi Hu, Paul Röttger, Barbara Plank
2025 J jnl
The Pluralistic Moral Gap: Understanding Judgment and Value Differences between Humans and Large Language Models.
CoRR
Giuseppe Russo, Debora Nozza, Paul Röttger, Dirk Hovy
2025 A* conf
TrojanStego: Your Language Model Can Secretly Be A Steganographic Privacy Leaking Agent.
EMNLP
Dominik Meier, Jan Philip Wahle, Paul Röttger, Terry Ruas, Bela Gipp
2025 J jnl
TrojanStego: Your Language Model Can Secretly Be A Steganographic Privacy Leaking Agent.
CoRR
Dominik Meier, Jan Philip Wahle, Paul Röttger, Terry Ruas, Bela Gipp
2024 — conf
"My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models.
ACL (Findings)
Xinpeng Wang, Bolei Ma, Chengzhi Hu, Leon Weber-Genzel, Paul Röttger, Frauke Kreuter, Dirk Hovy, Barbara Plank
2024 J jnl
"My Answer is C": First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models.
CoRR
Xinpeng Wang, Bolei Ma, Chengzhi Hu, Leon Weber-Genzel, Paul Röttger, Frauke Kreuter, Dirk Hovy, Barbara Plank
2024 — conf
Beyond Flesch-Kincaid: Prompt-based Metrics Improve Difficulty Classification of Educational Texts.
BEA
Donya Rooein, Paul Röttger, Anastassia Shaitarova, Dirk Hovy
2024 J jnl
Beyond Flesch-Kincaid: Prompt-based Metrics Improve Difficulty Classification of Educational Texts.
CoRR
Donya Rooein, Paul Röttger, Anastassia Shaitarova, Dirk Hovy
2024 J jnl
Compromesso! Italian Many-Shot Jailbreaks Undermine the Safety of Large Language Models.
CoRR
Fabio Pernisi, Dirk Hovy, Paul Röttger
2024 — conf
Compromesso! Italian Many-Shot Jailbreaks undermine the safety of Large Language Models.
ACL (Student Research Workshop)
Fabio Pernisi, Dirk Hovy, Paul Röttger
2024 — conf
Evaluating the Elementary Multilingual Capabilities of Large Language Models with MultiQ.
ACL (Findings)
Carolin Holtermann, Paul Röttger, Timm Dill, Anne Lauscher
2024 J jnl
Evaluating the Elementary Multilingual Capabilities of Large Language Models with MultiQ.
CoRR
Carolin Holtermann, Paul Röttger, Timm Dill, Anne Lauscher
2024 J jnl
Evidence of a log scaling law for political persuasion with large language models.
CoRR
Kobi Hackenburg, Ben M. Tappin, Paul Röttger, Scott Hale, Jonathan Bright, Helen Z. Margetts
2024 J jnl
From Languages to Geographies: Towards Evaluating Cultural Bias in Hate Speech Datasets.
CoRR
Manuel Tonneau, Diyi Liu, Samuel Fraiberger, Ralph Schroeder, Scott A. Hale, Paul Röttger
2024 J jnl
HateDay: Insights from a Global Hate Speech Dataset Representative of a Day on Twitter.
CoRR
Manuel Tonneau, Diyi Liu, Niyati Malhotra, Scott A. Hale, Samuel P. Fraiberger, Víctor Orozco-Olvera, Paul Röttger
2024 — conf
Improving Adversarial Data Collection by Supporting Annotators: Lessons from GAHD, a German Hate Speech Dataset.
NAACL-HLT
Janis Goldzycher, Paul Röttger, Gerold Schneider
2024 J jnl
Improving Adversarial Data Collection by Supporting Annotators: Lessons from GAHD, a German Hate Speech Dataset.
CoRR
Janis Goldzycher, Paul Röttger, Gerold Schneider
2024 J jnl
Introducing v0.5 of the AI Safety Benchmark from MLCommons.
CoRR
Bertie Vidgen, Adarsh Agrawal, Ahmed M. Ahmed, Victor Akinwande, Namir Al-Nuaimi, Najla Alfaraj, Elie Alhajjar, Lora Aroyo, Trupti Bavalatti, Borhane Blili-Hamelin, Kurt Bollacker, Rishi Bomassani, Marisa Ferrara Boston, Siméon Campos, Kal Chakra, Canyu Chen, Cody Coleman, Zacharie Delpierre Coudert, Leon Derczynski, Debojyoti Dutta, Ian Eisenberg, James Ezick, Heather Frase, Brian Fuller, Ram Gandikota, Agasthya Gangavarapu, Ananya Gangavarapu, James Gealy, Rajat Ghosh, James Goel, Usman Gohar, Subhra S. Goswami, Scott A. Hale, Wiebke Hutiri, Joseph Marvin Imperial, Surgan Jandial, Nick Judd, Felix Juefei-Xu, Foutse Khomh, Bhavya Kailkhura, Hannah Rose Kirk, Kevin Klyman, Chris Knotz, Michael Kuchnik, Shachi H. Kumar, Chris Lengerich, Bo Li, Zeyi Liao, Eileen Peters Long, Victor Lu, Yifan Mai, Priyanka Mary Mammen, Kelvin N. Manyeki, Sean McGregor, Virendra Mehta, Shafee Mohammed, Emanuel Moss, Lama Nachman, Dinesh Jinenhally Naganna, Amin Nikanjam, Besmira Nushi, Luis Oala, Iftach Orr, Alicia Parrish, Cigdem Patlak, William Pietri, Forough Poursabzi-Sangdeh, Eleonora Presani, Fabrizio Puletti, Paul Röttger, Saurav Sahay, Tim Santos, Nino Scherrer, Alice Schoenauer Sebag, Patrick Schramowski, Abolfazl Shahbazi, Vin Sharma, Xudong Shen, Vamsi Sistla, Leonard Tang, Davide Testuggine, Vithursan Thangarasa, Elizabeth Anne Watkins, Rebecca Weiss, Chris Welty, Tyler Wilbers, Adina Williams, Carole-Jean Wu, Poonam Yadav, Xianjun Yang, Yi Zeng, Wenhui Zhang, Fedor Zhdanov, Jiacheng Zhu, Percy Liang, Peter Mattson, Joaquin Vanschoren
2024 J jnl
Look at the Text: Instruction-Tuned Language Models are More Robust Multiple Choice Selectors than You Think.
CoRR
Xinpeng Wang, Chengzhi Hu, Bolei Ma, Paul Röttger, Barbara Plank
2024 J jnl
Near to Mid-term Risks and Opportunities of Open Source Generative AI.
CoRR
Francisco Eiras, Aleksandar Petrov, Bertie Vidgen, Christian Schröder de Witt, Fabio Pizzati, Katherine Elkins, Supratik Mukhopadhyay, Adel Bibi, Botos Csaba, Fabro Steibel, Fazl Barez, Genevieve Smith, Gianluca Guadagni, Jon Chun, Jordi Cabot, Joseph Marvin Imperial, Juan A. Nolazco-Flores, Lori Landay, Matthew Thomas Jackson, Paul Röttger, Philip H. S. Torr, Trevor Darrell, Yong Suk Lee, Jakob N. Foerster
2024 — conf
Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models.
ACL (1)
Paul Röttger, Valentin Hofmann, Valentina Pyatkin, Musashi Hinck, Hannah Kirk, Hinrich Schütze, Dirk Hovy
2024 J jnl
Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models.
CoRR
Paul Röttger, Valentin Hofmann, Valentina Pyatkin, Musashi Hinck, Hannah Rose Kirk, Hinrich Schütze, Dirk Hovy
2024 A* conf
Position: Near to Mid-term Risks and Opportunities of Open-Source Generative AI.
ICML
Francisco Eiras, Aleksandar Petrov, Bertie Vidgen, Christian Schröder de Witt, Fabio Pizzati, Katherine Elkins, Supratik Mukhopadhyay, Adel Bibi, Botos Csaba, Fabro Steibel, Fazl Barez, Genevieve Smith, Gianluca Guadagni, Jon Chun, Jordi Cabot, Joseph Marvin Imperial, Juan A. Nolazco-Flores, Lori Landay, Matthew Thomas Jackson, Paul Röttger, Philip H. S. Torr, Trevor Darrell, Yong Suk Lee, Jakob N. Foerster
2024 A* conf
Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructions.
ICLR
Federico Bianchi, Mirac Suzgun, Giuseppe Attanasio, Paul Röttger, Dan Jurafsky, Tatsunori Hashimoto, James Zou
2024 J jnl
SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model Safety.
CoRR
Paul Röttger, Fabio Pernisi, Bertie Vidgen, Dirk Hovy
2024 J jnl
Surgical, Cheap, and Flexible: Mitigating False Refusal in Language Models via Single Vector Ablation.
CoRR
Xinpeng Wang, Chengzhi Hu, Paul Röttger, Barbara Plank
2024 A* conf
The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models.
NeurIPS
Hannah Rose Kirk, Alexander Whitefield, Paul Röttger, Andrew M. Bean, Katerina Margatina, Rafael Mosquera Gómez, Juan Ciro, Max Bartolo, Adina Williams, He He, Bertie Vidgen, Scott Hale
2024 J jnl
The PRISM Alignment Project: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models.
CoRR
Hannah Rose Kirk, Alexander Whitefield, Paul Röttger, Andrew M. Bean, Katerina Margatina, Juan Ciro, Rafael Mosquera, Max Bartolo, Adina Williams, He He, Bertie Vidgen, Scott A. Hale
2024 J jnl
The benefits, risks and bounds of personalizing the alignment of large language models to individuals.
Nat. Mac. Intell.
Hannah Rose Kirk, Bertie Vidgen, Paul Röttger, Scott A. Hale
2024 — conf
XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models.
NAACL-HLT
Paul Röttger, Hannah Kirk, Bertie Vidgen, Giuseppe Attanasio, Federico Bianchi, Dirk Hovy
2023 — conf
Improving the Detection of Multilingual Online Attacks with Rich Social Media Data from Singapore.
ACL (1)
Janosch Haber, Bertie Vidgen, Matthew Chapman, Vibhor Agarwal, Roy Ka-Wei Lee, Yong Keong Yap, Paul Röttger
2023 J jnl
Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedback.
CoRR
Hannah Rose Kirk, Bertie Vidgen, Paul Röttger, Scott A. Hale
2023 J jnl
Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructions.
CoRR
Federico Bianchi, Mirac Suzgun, Giuseppe Attanasio, Paul Röttger, Dan Jurafsky, Tatsunori Hashimoto, James Zou
2023 — conf
SemEval-2023 Task 10: Explainable Detection of Online Sexism.
SemEval@ACL
Hannah Kirk, Wenjie Yin, Bertie Vidgen, Paul Röttger
2023 J jnl
SemEval-2023 Task 10: Explainable Detection of Online Sexism.
CoRR
Hannah Rose Kirk, Wenjie Yin, Bertie Vidgen, Paul Röttger
2023 J jnl
SimpleSafetyTests: a Test Suite for Identifying Critical Safety Risks in Large Language Models.
CoRR
Bertie Vidgen, Hannah Rose Kirk, Rebecca Qian, Nino Scherrer, Anand Kannappan, Scott A. Hale, Paul Röttger
2023 — conf
The Ecological Fallacy in Annotation: Modeling Human Label Variation goes beyond Sociodemographics.
ACL (2)
Matthias Orlikowski, Paul Röttger, Philipp Cimiano, Dirk Hovy
2023 J jnl
The Ecological Fallacy in Annotation: Modelling Human Label Variation goes beyond Sociodemographics.
CoRR
Matthias Orlikowski, Paul Röttger, Philipp Cimiano, Dirk Hovy
2023 J jnl
The Empty Signifier Problem: Towards Clearer Paradigms for Operationalising "Alignment" in Large Language Models.
CoRR
Hannah Rose Kirk, Bertie Vidgen, Paul Röttger, Scott A. Hale
2023 A* conf
The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Values.
EMNLP
Hannah Kirk, Andrew M. Bean, Bertie Vidgen, Paul Röttger, Scott Hale
2023 J jnl
The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Values.
CoRR
Hannah Rose Kirk, Andrew M. Bean, Bertie Vidgen, Paul Röttger, Scott A. Hale
2023 J jnl
XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models.
CoRR
Paul Röttger, Hannah Rose Kirk, Bertie Vidgen, Giuseppe Attanasio, Federico Bianchi, Dirk Hovy
2022 A* conf
Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languages.
EMNLP
Paul Röttger, Debora Nozza, Federico Bianchi, Dirk Hovy
2022 J jnl
Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languages.
CoRR
Paul Röttger, Debora Nozza, Federico Bianchi, Dirk Hovy
2022 — conf
Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-Based Hate.
NAACL-HLT
Hannah Kirk, Bertie Vidgen, Paul Röttger, Tristan Thrush, Scott Hale
2022 J jnl
Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Models.
CoRR
Paul Röttger, Haitham Seelawi, Debora Nozza, Zeerak Talat, Bertie Vidgen
2022 — conf
Two Contrasting Data Annotation Paradigms for Subjective NLP Tasks.
NAACL-HLT
Paul Röttger, Bertie Vidgen, Dirk Hovy, Janet B. Pierrehumbert
2021 — conf
HateCheck: Functional Tests for Hate Speech Detection Models.
ACL/IJCNLP (1)
Paul Röttger, Bertie Vidgen, Dong Nguyen, Zeerak Waseem, Helen Z. Margetts, Janet B. Pierrehumbert
2021 J jnl
Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-based Hate.
CoRR
Hannah Rose Kirk, Bertram Vidgen, Paul Röttger, Tristan Thrush, Scott Hale
2021 — conf
Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Media.
EMNLP (Findings)
Paul Röttger, Janet B. Pierrehumbert
2021 J jnl
Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Media.
CoRR
Paul Röttger, Janet B. Pierrehumbert
2021 J jnl
Two Contrasting Data Annotation Paradigms for Subjective NLP Tasks.
CoRR
Paul Röttger, Bertie Vidgen, Dirk Hovy, Janet B. Pierrehumbert
2020 J jnl
HateCheck: Functional Tests for Hate Speech Detection Models.
CoRR
Paul Röttger, Bertram Vidgen, Dong Nguyen, Zeerak Waseem, Helen Z. Margetts, Janet B. Pierrehumbert