Melanie Sclar

26 papers A* 9Journal 15Unranked 2
YearRankTypeTitle / Venue / Authors
2025 A* conf
AI as Humanity's Salieri: Quantifying Linguistic Creativity of Language Models via Systematic Attribution of Machine Text against Web Text.
ICLR
Ximing Lu, Melanie Sclar, Skyler Hallinan, Niloofar Mireshghallah, Jiacheng Liu, Seungju Han, Allyson Ettinger, Liwei Jiang, Khyathi Raghavi Chandu, Nouha Dziri, Yejin Choi
2025 A* conf
Explore Theory of Mind: program-guided adversarial data generation for theory of mind reasoning.
ICLR
Melanie Sclar, Jane Dwivedi-Yu, Maryam Fazel-Zarandi, Yulia Tsvetkov, Yonatan Bisk, Yejin Choi, Asli Celikyilmaz
2025 J jnl
Finding Flawed Fictions: Evaluating Complex Reasoning in Language Models via Plot Hole Detection.
CoRR
Kabir Ahuja, Melanie Sclar, Yulia Tsvetkov
2025 J jnl
Hypothesis-Driven Theory-of-Mind Reasoning for Large Language Models.
CoRR
Hyunwoo Kim, Melanie Sclar, Tan Zhi-Xuan, Lance Ying, Sydney Levine, Yang Liu, Joshua B. Tenenbaum, Yejin Choi
2025 J jnl
PrefPalette: Personalized Preference Modeling with Latent Attributes.
CoRR
Shuyue Stella Li, Melanie Sclar, Hunter Lang, Ansong Ni, Jacqueline He, Puxin Xu, Andrew Cohen, Chan Young Park, Yulia Tsvetkov, Asli Celikyilmaz
2025 J jnl
The Surprising Effectiveness of Membership Inference with Simple N-Gram Coverage.
CoRR
Skyler Hallinan, Jaehun Jung, Melanie Sclar, Ximing Lu, Abhilasha Ravichander, Sahana Ramnath, Yejin Choi, Sai Praneeth Karimireddy, Niloofar Mireshghallah, Xiang Ren
2024 J jnl
AI as Humanity's Salieri: Quantifying Linguistic Creativity of Language Models via Systematic Attribution of Machine Text against Web Text.
CoRR
Ximing Lu, Melanie Sclar, Skyler Hallinan, Niloofar Mireshghallah, Jiacheng Liu, Seungju Han, Allyson Ettinger, Liwei Jiang, Khyathi Raghavi Chandu, Nouha Dziri, Yejin Choi
2024 J jnl
Explore Theory of Mind: Program-guided adversarial data generation for theory of mind reasoning.
CoRR
Melanie Sclar, Jane A. Yu, Maryam Fazel-Zarandi, Yulia Tsvetkov, Yonatan Bisk, Yejin Choi, Asli Celikyilmaz
2024 A* conf
Phenomenal Yet Puzzling: Testing Inductive Reasoning Capabilities of Language Models with Hypothesis Refinement.
ICLR
Linlu Qiu, Liwei Jiang, Ximing Lu, Melanie Sclar, Valentina Pyatkin, Chandra Bhagavatula, Bailin Wang, Yoon Kim, Yejin Choi, Nouha Dziri, Xiang Ren
2024 A* conf
Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting.
ICLR
Melanie Sclar, Yejin Choi, Yulia Tsvetkov, Alane Suhr
2024 A* conf
The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learning.
ICLR
Bill Yuchen Lin, Abhilasha Ravichander, Ximing Lu, Nouha Dziri, Melanie Sclar, Khyathi Raghavi Chandu, Chandra Bhagavatula, Yejin Choi
2023 — conf
BotPercent: Estimating Bot Populations in Twitter Communities.
EMNLP (Findings)
Zhaoxuan Tan, Shangbin Feng, Melanie Sclar, Herun Wan, Minnan Luo, Yejin Choi, Yulia Tsvetkov
2023 J jnl
BotPercent: Estimating Twitter Bot Populations from Groups to Crowds.
CoRR
Zhaoxuan Tan, Shangbin Feng, Melanie Sclar, Herun Wan, Minnan Luo, Yejin Choi, Yulia Tsvetkov
2023 A* conf
FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions.
EMNLP
Hyunwoo Kim, Melanie Sclar, Xuhui Zhou, Ronan Le Bras, Gunhee Kim, Yejin Choi, Maarten Sap
2023 J jnl
FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions.
CoRR
Hyunwoo Kim, Melanie Sclar, Xuhui Zhou, Ronan Le Bras, Gunhee Kim, Yejin Choi, Maarten Sap
2023 A* conf
Faith and Fate: Limits of Transformers on Compositionality.
NeurIPS
Nouha Dziri, Ximing Lu, Melanie Sclar, Xiang Lorraine Li, Liwei Jiang, Bill Yuchen Lin, Sean Welleck, Peter West, Chandra Bhagavatula, Ronan Le Bras, Jena D. Hwang, Soumya Sanyal, Xiang Ren, Allyson Ettinger, Zaïd Harchaoui, Yejin Choi
2023 J jnl
Faith and Fate: Limits of Transformers on Compositionality.
CoRR
Nouha Dziri, Ximing Lu, Melanie Sclar, Xiang Lorraine Li, Liwei Jiang, Bill Yuchen Lin, Peter West, Chandra Bhagavatula, Ronan Le Bras, Jena D. Hwang, Soumya Sanyal, Sean Welleck, Xiang Ren, Allyson Ettinger, Zaïd Harchaoui, Yejin Choi
2023 — conf
Minding Language Models' (Lack of) Theory of Mind: A Plug-and-Play Multi-Character Belief Tracker.
ACL (1)
Melanie Sclar, Sachin Kumar, Peter West, Alane Suhr, Yejin Choi, Yulia Tsvetkov
2023 J jnl
Minding Language Models' (Lack of) Theory of Mind: A Plug-and-Play Multi-Character Belief Tracker.
CoRR
Melanie Sclar, Sachin Kumar, Peter West, Alane Suhr, Yejin Choi, Yulia Tsvetkov
2023 J jnl
Phenomenal Yet Puzzling: Testing Inductive Reasoning Capabilities of Language Models with Hypothesis Refinement.
CoRR
Linlu Qiu, Liwei Jiang, Ximing Lu, Melanie Sclar, Valentina Pyatkin, Chandra Bhagavatula, Bailin Wang, Yoon Kim, Yejin Choi, Nouha Dziri, Xiang Ren
2023 J jnl
Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting.
CoRR
Melanie Sclar, Yejin Choi, Yulia Tsvetkov, Alane Suhr
2023 J jnl
The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learning.
CoRR
Bill Yuchen Lin, Abhilasha Ravichander, Ximing Lu, Nouha Dziri, Melanie Sclar, Khyathi Raghavi Chandu, Chandra Bhagavatula, Yejin Choi
2022 A* conf
Referee: Reference-Free Sentence Summarization with Sharper Controllability through Symbolic Knowledge Distillation.
EMNLP
Melanie Sclar, Peter West, Sachin Kumar, Yulia Tsvetkov, Yejin Choi
2022 J jnl
Referee: Reference-Free Sentence Summarization with Sharper Controllability through Symbolic Knowledge Distillation.
CoRR
Melanie Sclar, Peter West, Sachin Kumar, Yulia Tsvetkov, Yejin Choi
2022 A* conf
Symmetric Machine Theory of Mind.
ICML
Melanie Sclar, Graham Neubig, Yonatan Bisk
2020 J jnl
Modeling human visual search: A combined Bayesian searcher and saliency map approach for eye movement guidance in natural scenes.
CoRR
Melanie Sclar, Gastón Bujia, Sebastián Vita, Guillermo Solovey, Juan E. Kamienkowski