Emily Sheng

28 papers Journal 17Unranked 11
YearRankTypeTitle / Venue / Authors
2025 — conf
Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge.
ICML (Position Papers)
Hanna M. Wallach, Meera A. Desai, A. Feder Cooper, Angelina Wang, Chad Atalla, Solon Barocas, Su Lin Blodgett, Alexandra Chouldechova, Emily Corvi, P. Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Nicholas J. Pangakis, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs
2025 J jnl
Position: Evaluating Generative AI Systems is a Social Science Measurement Challenge.
CoRR
Hanna M. Wallach, Meera A. Desai, A. Feder Cooper, Angelina Wang, Chad Atalla, Solon Barocas, Su Lin Blodgett, Alexandra Chouldechova, Emily Corvi, P. Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Nicholas Pangakis, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs
2025 — conf
Taxonomizing Representational Harms using Speech Act Theory.
ACL (Findings)
Emily Corvi, Hannah Washington, Stefanie Reed, Chad Atalla, Alexandra Chouldechova, P. Alex Dow, Jean Garcia-Gathright, Nicholas J. Pangakis, Emily Sheng, Dan Vann, Matthew Vogel, Hanna M. Wallach
2025 J jnl
Taxonomizing Representational Harms using Speech Act Theory.
CoRR
Emily Corvi, Hannah Washington, Stefanie Reed, Chad Atalla, Alexandra Chouldechova, P. Alex Dow, Jean Garcia-Gathright, Nicholas Pangakis, Emily Sheng, Dan Vann, Matthew Vogel, Hanna M. Wallach
2025 — conf
Understanding and Meeting Practitioner Needs When Measuring Representational Harms Caused by LLM-Based Systems.
ACL (Findings)
Emma Harvey, Emily Sheng, Su Lin Blodgett, Alexandra Chouldechova, Jean Garcia-Gathright, Alexandra Olteanu, Hanna M. Wallach
2025 J jnl
Understanding and Meeting Practitioner Needs When Measuring Representational Harms Caused by LLM-Based Systems.
CoRR
Emma Harvey, Emily Sheng, Su Lin Blodgett, Alexandra Chouldechova, Jean Garcia-Gathright, Alexandra Olteanu, Hanna M. Wallach
2024 J jnl
A Shared Standard for Valid Measurement of Generative AI Systems' Capabilities, Risks, and Impacts.
CoRR
Alexandra Chouldechova, Chad Atalla, Solon Barocas, A. Feder Cooper, Emily Corvi, P. Alex Dow, Jean Garcia-Gathright, Nicholas Pangakis, Stefanie Reed, Emily Sheng, Dan Vann, Matthew Vogel, Hannah Washington, Hanna M. Wallach
2024 J jnl
Evaluating Generative AI Systems is a Social Science Measurement Challenge.
CoRR
Hanna M. Wallach, Meera A. Desai, Nicholas Pangakis, A. Feder Cooper, Angelina Wang, Solon Barocas, Alexandra Chouldechova, Chad Atalla, Su Lin Blodgett, Emily Corvi, P. Alex Dow, Jean Garcia-Gathright, Alexandra Olteanu, Stefanie Reed, Emily Sheng, Dan Vann, Jennifer Wortman Vaughan, Matthew Vogel, Hannah Washington, Abigail Z. Jacobs
2024 J jnl
Gaps Between Research and Practice When Measuring Representational Harms Caused by LLM-Based Systems.
CoRR
Emma Harvey, Emily Sheng, Su Lin Blodgett, Alexandra Chouldechova, Jean Garcia-Gathright, Alexandra Olteanu, Hanna M. Wallach
2023 J jnl
A Framework for Automated Measurement of Responsible AI Harms in Generative AI Applications.
CoRR
Ahmed Magooda, Alec Helyar, Kyle Jackson, David Sullivan, Chad Atalla, Emily Sheng, Dan Vann, Richard Edgar, Hamid Palangi, Roman Lutz, Hongliang Kong, Vincent Yun, Eslam Kamal, Federico Zarfati, Hanna M. Wallach, Sarah Bird, Mei Chen
2023 — conf
FairPrism: Evaluating Fairness-Related Harms in Text Generation.
ACL (1)
Eve Fleisig, Aubrie Amstutz, Chad Atalla, Su Lin Blodgett, Hal Daumé III, Alexandra Olteanu, Emily Sheng, Dan Vann, Hanna M. Wallach
2022 J jnl
A Keyword Based Approach to Understanding the Overpenalization of Marginalized Groups by English Marginal Abuse Models on Twitter.
CoRR
Kyra Yee, Alice Schoenauer Sebag, Olivia Redfield, Emily Sheng, Matthias Eck, Luca Belli
2022 — conf
On Measures of Biases and Harms in NLP.
AACL/IJCNLP (Findings)
Sunipa Dev, Emily Sheng, Jieyu Zhao, Aubrie Amstutz, Jiao Sun, Yu Hou, Mattie Sanseverino, Jiin Kim, Akihiro Nishi, Nanyun Peng, Kai-Wei Chang
2021 — conf
"Nice Try, Kiddo": Investigating Ad Hominems in Dialogue Responses.
NAACL-HLT
Emily Sheng, Kai-Wei Chang, Prem Natarajan, Nanyun Peng
2021 J jnl
Revealing Persona Biases in Dialogue Systems.
CoRR
Emily Sheng, Josh Arnold, Zhou Yu, Kai-Wei Chang, Nanyun Peng
2021 — conf
Societal Biases in Language Generation: Progress and Challenges.
ACL/IJCNLP (1)
Emily Sheng, Kai-Wei Chang, Prem Natarajan, Nanyun Peng
2021 J jnl
Societal Biases in Language Generation: Progress and Challenges.
CoRR
Emily Sheng, Kai-Wei Chang, Premkumar Natarajan, Nanyun Peng
2021 J jnl
What do Bias Measures Measure?
CoRR
Sunipa Dev, Emily Sheng, Jieyu Zhao, Jiao Sun, Yu Hou, Mattie Sanseverino, Jiin Kim, Nanyun Peng, Kai-Wei Chang
2020 J jnl
"Nice Try, Kiddo": Ad Hominems in Dialogue Systems.
CoRR
Emily Sheng, Kai-Wei Chang, Premkumar Natarajan, Nanyun Peng
2020 J jnl
Investigating Societal Biases in a Poetry Composition System.
CoRR
Emily Sheng, David C. Uthus
2020 — conf
Towards Controllable Biases in Language Generation.
EMNLP (Findings)
Emily Sheng, Kai-Wei Chang, Prem Natarajan, Nanyun Peng
2020 J jnl
Towards Controllable Biases in Language Generation.
CoRR
Emily Sheng, Kai-Wei Chang, Premkumar Natarajan, Nanyun Peng
2019 — conf
The Woman Worked as a Babysitter: On Biases in Language Generation.
EMNLP/IJCNLP (1)
Emily Sheng, Kai-Wei Chang, Premkumar Natarajan, Nanyun Peng
2019 J jnl
The Woman Worked as a Babysitter: On Biases in Language Generation.
CoRR
Emily Sheng, Kai-Wei Chang, Premkumar Natarajan, Nanyun Peng
2018 J jnl
A Byte-sized Approach to Named Entity Recognition.
CoRR
Emily Sheng, Prem Natarajan
2017 — conf
An Investigation into the Pedagogical Features of Documents.
BEA@EMNLP
Emily Sheng, Prem Natarajan, Jonathan Gordon, Gully Burns
2017 J jnl
An Investigation into the Pedagogical Features of Documents.
CoRR
Emily Sheng, Prem Natarajan, Jonathan Gordon, Gully Burns
2017 — conf
Structured Generation of Technical Reading Lists.
BEA@EMNLP
Jonathan Gordon, Stephen Aguilar, Emily Sheng, Gully Burns