Sunipa Dev

63 papers A* 7A 1Journal 36Unranked 18
YearRankTypeTitle / Venue / Authors
2026 J jnl
A Unified Framework to Quantify Cultural Intelligence of AI.
CoRR
Sunipa Dev, Vinodkumar Prabhakaran, Rutledge Chin Feman, Aida Mostafazadeh Davani, Remi Denton, Charu Kalia, Piyawat Lertvittayakumjorn, Madhurima Maji, Rida Qadri, Negar Rostamzadeh, Renee Shelby, Romina Stella, Hayk Stepanyan, Erin van Liemt, Aishwarya Verma, Oscar Wahltinez, Edem Wornyo, Andrew Zaldivar, Saska Mojsilovic
2026 J jnl
Cultural Compass: A Framework for Organizing Societal Norms to Detect Violations in Human-AI Conversations.
CoRR
Myra Cheng, Vinodkumar Prabhakaran, Alice Oh, Hayk Stepanyan, Aishwarya Verma, Charu Kalia, Erin MacMurray van Liemt, Sunipa Dev
2026 — conf
SAFARI: A Community-Engaged Approach and Dataset of Stereotype Resources in the Sub-Saharan African Context.
EACL (Volume 2: Short Papers)
Aishwarya Verma, Laud Ammah, Olivia Nercy Ndlovu Lucas, Andrew Zaldivar, Vinodkumar Prabhakaran, Sunipa Dev
2026 J jnl
SAFARI: A Community-Engaged Approach and Dataset of Stereotype Resources in the Sub-Saharan African Context.
CoRR
Aishwarya Verma, Laud Ammah, Olivia Nercy Ndlovu Lucas, Andrew Zaldivar, Vinodkumar Prabhakaran, Sunipa Dev
2026 — conf
Scaling Cultural Resources for Improving Generative Models.
EACL (Findings)
Hayk Stepanyan, Aishwarya Verma, Andrew Zaldivar, Rutledge Chin Feman, Erin MacMurray van Liemt, Charu Kalia, Vinodkumar Prabhakaran, Sunipa Dev
2025 A* conf
A Comprehensive Framework to Operationalize Social Stereotypes for Responsible AI Evaluations.
EMNLP
Aida Mostafazadeh Davani, Sunipa Dev, Héctor Pérez-Urbina, Vinodkumar Prabhakaran
2025 J jnl
A Comprehensive Framework to Operationalize Social Stereotypes for Responsible AI Evaluations.
CoRR
Aida Mostafazadeh Davani, Sunipa Dev, Héctor Pérez-Urbina, Vinodkumar Prabhakaran
2025 J jnl
Adaptive Data Collection for Latin-American Community-sourced Evaluation of Stereotypes (LACES).
CoRR
Guido Ivetta, Pietro Palombini, Sofía Martinelli, Marcos J. Gomez, Sunipa Dev, Vinodkumar Prabhakaran, Luciana Benotti
2025 — conf
Amplifying Trans and Nonbinary Voices: A Community-Centred Harm Taxonomy for LLMs.
ACL (1)
Eddie L. Ungless, Sunipa Dev, Cynthia L. Bennett, Rebecca Gulotta, Jasmijn Bastings, Remi Denton
2025 J jnl
Scaling Cultural Resources for Improving Generative Models.
CoRR
Hayk Stepanyan, Aishwarya Verma, Andrew Zaldivar, Rutledge Chin Feman, Erin MacMurray van Liemt, Charu Kalia, Vinodkumar Prabhakaran, Sunipa Dev
2025 — conf
Towards Geo-Culturally Grounded LLM Generations.
ACL (2)
Piyawat Lertvittayakumjorn, David Kinney, Vinodkumar Prabhakaran, Donald Martin Jr., Sunipa Dev
2025 J jnl
Towards Geo-Culturally Grounded LLM Generations.
CoRR
Piyawat Lertvittayakumjorn, David Kinney, Vinodkumar Prabhakaran, Donald Martin Jr., Sunipa Dev
2024 J jnl
Beyond the Surface: A Global-Scale Analysis of Visual Stereotypes in Text-to-Image Generation.
CoRR
Akshita Jha, Vinodkumar Prabhakaran, Remi Denton, Sarah Laszlo, Shachi Dave, Rida Qadri, Chandan K. Reddy, Sunipa Dev
2024 J jnl
GeniL: A Multilingual Dataset on Generalizing Language.
CoRR
Aida Mostafazadeh Davani, Sagar Gubbi, Sunipa Dev, Shachi Dave, Vinodkumar Prabhakaran
2024 A* conf
MiTTenS: A Dataset for Evaluating Gender Mistranslation.
EMNLP
Kevin Robinson, Sneha Kudugunta, Romina Stella, Sunipa Dev, Jasmijn Bastings
2024 J jnl
MiTTenS: A Dataset for Evaluating Misgendering in Translation.
CoRR
Kevin Robinson, Sneha Kudugunta, Romina Stella, Sunipa Dev, Jasmijn Bastings
2024 — conf
MisgenderMender: A Community-Informed Approach to Interventions for Misgendering.
NAACL-HLT
Tamanna Hossain, Sunipa Dev, Sameer Singh
2024 J jnl
MisgenderMender: A Community-Informed Approach to Interventions for Misgendering.
CoRR
Tamanna Hossain, Sunipa Dev, Sameer Singh
2024 J jnl
SeeGULL Multilingual: a Dataset of Geo-Culturally Situated Stereotypes.
CoRR
Mukul Bhutani, Kevin Robinson, Vinodkumar Prabhakaran, Shachi Dave, Sunipa Dev
2024 — conf
SoUnD Framework: Analyzing (So)cial Representation in (Un)structured (D)ata.
AIES (1)
Mark Diaz, Sunipa Dev, Emily Reif, Emily Denton, Vinodkumar Prabhakaran
2024 J jnl
VERB: Visualizing and Interpreting Bias Mitigation Techniques Geometrically for Word Representations.
ACM Trans. Interact. Intell. Syst.
Archit Rathore, Sunipa Dev, Jeff M. Phillips, Vivek Srikumar, Yan Zheng, Chin-Chia Michael Yeh, Junpeng Wang, Wei Zhang, Bei Wang
2024 — conf
ViSAGe: A Global-Scale Analysis of Visual Stereotypes in Text-to-Image Generation.
ACL (1)
Akshita Jha, Vinodkumar Prabhakaran, Remi Denton, Sarah Laszlo, Shachi Dave, Rida Qadri, Chandan K. Reddy, Sunipa Dev
2023 — conf
"I wouldn't say offensive but...": Disability-Centered Perspectives on Large Language Models.
FAccT
Vinitha Gadiraju, Shaun K. Kane, Sunipa Dev, Alex S. Taylor, Ding Wang, Emily Denton, Robin Brewer
2023 A* conf
Building Socio-culturally Inclusive Stereotype Resources with Community Engagement.
NeurIPS
Sunipa Dev, Jaya Goyal, Dinesh Tewari, Shachi Dave, Vinodkumar Prabhakaran
2023 J jnl
Building Socio-culturally Inclusive Stereotype Resources with Community Engagement.
CoRR
Sunipa Dev, Jaya Goyal, Dinesh Tewari, Shachi Dave, Vinodkumar Prabhakaran
2023 — conf
MISGENDERED: Limits of Large Language Models in Understanding Pronouns.
ACL (1)
Tamanna Hossain, Sunipa Dev, Sameer Singh
2023 J jnl
MISGENDERED: Limits of Large Language Models in Understanding Pronouns.
CoRR
Tamanna Hossain, Sunipa Dev, Sameer Singh
2023 J jnl
PaLM 2 Technical Report.
CoRR
Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, Eric Chu, Jonathan H. Clark, Laurent El Shafey, Yanping Huang, Kathy Meier-Hellstern, Gaurav Mishra, Erica Moreira, Mark Omernick, Kevin Robinson, Sebastian Ruder, Yi Tay, Kefan Xiao, Yuanzhong Xu, Yujing Zhang, Gustavo Hernández Ábrego, Junwhan Ahn, Jacob Austin, Paul Barham, Jan A. Botha, James Bradbury, Siddhartha Brahma, Kevin Brooks, Michele Catasta, Yong Cheng, Colin Cherry, Christopher A. Choquette-Choo, Aakanksha Chowdhery, Clément Crepy, Shachi Dave, Mostafa Dehghani, Sunipa Dev, Jacob Devlin, Mark Díaz, Nan Du, Ethan Dyer, Vladimir Feinberg, Fangxiaoyu Feng, Vlad Fienber, Markus Freitag, Xavier Garcia, Sebastian Gehrmann, Lucas Gonzalez, et al.
2023 J jnl
PaLM: Scaling Language Modeling with Pathways.
J. Mach. Learn. Res.
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel
2023 — conf
SeeGULL: A Stereotype Benchmark with Broad Geo-Cultural Coverage Leveraging Generative Models.
ACL (1)
Akshita Jha, Aida Mostafazadeh Davani, Chandan K. Reddy, Shachi Dave, Vinodkumar Prabhakaran, Sunipa Dev
2023 J jnl
SeeGULL: A Stereotype Benchmark with Broad Geo-Cultural Coverage Leveraging Generative Models.
CoRR
Akshita Jha, Aida Mostafazadeh Davani, Chandan K. Reddy, Shachi Dave, Vinodkumar Prabhakaran, Sunipa Dev
2023 J jnl
SoUnD Framework: Analyzing (So)cial Representation in (Un)structured (D)ata.
CoRR
Mark Díaz, Sunipa Dev, Emily Reif, Remi Denton, Vinodkumar Prabhakaran
2023 — conf
The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarks.
ACL (2)
Nikil Roashan Selvam, Sunipa Dev, Daniel Khashabi, Tushar Khot, Kai-Wei Chang
2022 J jnl
Auditing Algorithmic Fairness in Machine Learning for Health with Severity-Based LOGAN.
CoRR
Anaelia Ovalle, Sunipa Dev, Jieyu Zhao, Majid Sarrafzadeh, Kai-Wei Chang
2022 J jnl
Cultural Re-contextualization of Fairness Research in Language Technologies in India.
CoRR
Shaily Bhatt, Sunipa Dev, Partha P. Talukdar, Shachi Dave, Vinodkumar Prabhakaran
2022 J jnl
DisinfoMeme: A Multimodal Dataset for Detecting Meme Intentionally Spreading Out Disinformation.
CoRR
Jingnong Qu, Liunian Harold Li, Jieyu Zhao, Sunipa Dev, Kai-Wei Chang
2022 — conf
On Measures of Biases and Harms in NLP.
AACL/IJCNLP (Findings)
Sunipa Dev, Emily Sheng, Jieyu Zhao, Aubrie Amstutz, Jiao Sun, Yu Hou, Mattie Sanseverino, Jiin Kim, Akihiro Nishi, Nanyun Peng, Kai-Wei Chang
2022 J jnl
PaLM: Scaling Language Modeling with Pathways.
CoRR
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel
2022 — conf
Re-contextualizing Fairness in NLP: The Case of India.
AACL/IJCNLP (1)
Shaily Bhatt, Sunipa Dev, Partha P. Talukdar, Shachi Dave, Vinodkumar Prabhakaran
2022 J jnl
Re-contextualizing Fairness in NLP: The Case of India.
CoRR
Shaily Bhatt, Sunipa Dev, Partha P. Talukdar, Shachi Dave, Vinodkumar Prabhakaran
2022 — conf
Representation Learning for Resource-Constrained Keyphrase Generation.
EMNLP (Findings)
Di Wu, Wasi Uddin Ahmad, Sunipa Dev, Kai-Wei Chang
2022 J jnl
Representation Learning for Resource-Constrained Keyphrase Generation.
CoRR
Di Wu, Wasi Uddin Ahmad, Sunipa Dev, Kai-Wei Chang
2022 — conf
Socially Aware Bias Measurements for Hindi Language Representations.
NAACL-HLT
Vijit Malik, Sunipa Dev, Akihiro Nishi, Nanyun Peng, Kai-Wei Chang
2022 J jnl
The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarks.
CoRR
Nikil Roashan Selvam, Sunipa Dev, Daniel Khashabi, Tushar Khot, Kai-Wei Chang
2021 A* conf
A Visual Tour of Bias Mitigation Techniques for Word Representations.
KDD
Archit Rathore, Sunipa Dev, Jeff M. Phillips, Vivek Srikumar, Bei Wang
2021 — conf
An Interactive Visual Demo of Bias Mitigation Techniques for Word Representations From a Geometric Perspective.
NeurIPS (Competition and Demos)
Archit Rathore, Sunipa Dev, Vivek Srikumar, Jeff M. Phillips, Yan Zheng, Chin-Chia Michael Yeh, Junpeng Wang, Wei Zhang, Bei Wang
2021 J jnl
Closed form word embedding alignment.
Knowl. Inf. Syst.
Sunipa Dev, Safia Hassan, Jeff M. Phillips
2021 — conf
Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologies.
EMNLP (1)
Sunipa Dev, Masoud Monajatipoor, Anaelia Ovalle, Arjun Subramonian, Jeff M. Phillips, Kai-Wei Chang
2021 J jnl
Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologies.
CoRR
Sunipa Dev, Masoud Monajatipoor, Anaelia Ovalle, Arjun Subramonian, Jeff M. Phillips, Kai-Wei Chang
2021 A* conf
Measures and Best Practices for Responsible AI.
KDD
Sunipa Dev, Mehrnoosh Sameki, Jwala Dhamala, Cho-Jui Hsieh
2021 — conf
OSCaR: Orthogonal Subspace Correction and Rectification of Biases in Word Embeddings.
EMNLP (1)
Sunipa Dev, Tao Li, Jeff M. Phillips, Vivek Srikumar
2021 J jnl
Socially Aware Bias Measurements for Hindi Language Representations.
CoRR
Vijit Malik, Sunipa Dev, Akihiro Nishi, Nanyun Peng, Kai-Wei Chang
2021 J jnl
VERB: Visualizing and Interpreting Bias Mitigation Techniques for Word Representations.
CoRR
Archit Rathore, Sunipa Dev, Jeff M. Phillips, Vivek Srikumar, Yan Zheng, Chin-Chia Michael Yeh, Junpeng Wang, Wei Zhang, Bei Wang
2021 J jnl
What do Bias Measures Measure?
CoRR
Sunipa Dev, Emily Sheng, Jieyu Zhao, Jiao Sun, Yu Hou, Mattie Sanseverino, Jiin Kim, Nanyun Peng, Kai-Wei Chang
2020 J jnl
OSCaR: Orthogonal Subspace Correction and Rectification of Biases in Word Embeddings.
CoRR
Sunipa Dev, Tao Li, Jeff M. Phillips, Vivek Srikumar
2020 A* conf
On Measuring and Mitigating Biased Inferences of Word Embeddings.
AAAI
Sunipa Dev, Tao Li, Jeff M. Phillips, Vivek Srikumar
2020 J jnl
The Geometry of Distributed Representations for Better Alignment, Attenuated Bias, and Improved Interpretability.
CoRR
Sunipa Dev
2020 — —
The Geometry of Distributed Representations for Better Alignment, Attenuated Bias, and Improved Interpretability.
Sunipa Dev
2019 J jnl
Attenuating Bias in Word Vectors.
CoRR
Sunipa Dev, Jeff M. Phillips
2019 A conf
Attenuating Bias in Word vectors.
AISTATS
Sunipa Dev, Jeff M. Phillips
2019 A* conf
Closed Form Word Embedding Alignment.
ICDM
Sunipa Dev, Safia Hassan, Jeff M. Phillips
2019 J jnl
On Measuring and Mitigating Biased Inferences of Word Embeddings.
CoRR
Sunipa Dev, Tao Li, Jeff M. Phillips, Vivek Srikumar
2018 J jnl
Absolute Orientation for Word Embedding Alignment.
CoRR
Sunipa Dev, Safia Hassan, Jeff M. Phillips