Karolina Stanczak

28 papers A* 4Journal 20Unranked 4

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	DeepSeek-R1 Thoughtology: Let's think about LLM reasoning. Trans. Mach. Learn. Res. Sara Vera Marjanovic, Arkil Patel, Vaibhav Adlakha, Milad Aghajohari, Parishad BehnamGhader, Mehar Bhatia, Aditi Khandelwal, Austin Kraft, Benno Krojer, Xing Han Lù, Nicholas Meade, Dongchan Shin, Amirhossein Kazemnejad, Gaurav Kamath, Marius Mosbach, Karolina Stanczak, Siva Reddy
2026	J	`jnl`	On Optimizing Multimodal Jailbreaks for Spoken Language Models. CoRR Aravind Krishnan, Karolina Stanczak, Dietrich Klakow
2025	J	`jnl`	AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories. CoRR Xing Han Lù, Amirhossein Kazemnejad, Nicholas Meade, Arkil Patel, Dongchan Shin, Alejandra Zambrano, Karolina Stanczak, Peter Shaw, Christopher J. Pal, Siva Reddy
2025	—	`conf`	CulturalFrames: Assessing Cultural Expectation Alignment in Text-to-Image Models and Evaluation Metrics. EMNLP (Findings) Shravan Nayak, Mehar Bhatia, Xiaofeng Zhang, Verena Rieser, Lisa Anne Hendricks, Sjoerd van Steenkiste, Yash Goyal, Karolina Stanczak, Aishwarya Agrawal
2025	J	`jnl`	CulturalFrames: Assessing Cultural Expectation Alignment in Text-to-Image Models and Evaluation Metrics. CoRR Shravan Nayak, Mehar Bhatia, Xiaofeng Zhang, Verena Rieser, Lisa Anne Hendricks, Sjoerd van Steenkiste, Yash Goyal, Karolina Stanczak, Aishwarya Agrawal
2025	J	`jnl`	DeepSeek-R1 Thoughtology: Let's about LLM Reasoning. CoRR Sara Vera Marjanovic, Arkil Patel, Vaibhav Adlakha, Milad Aghajohari, Parishad BehnamGhader, Mehar Bhatia, Aditi Khandelwal, Austin Kraft, Benno Krojer, Xing Han Lù, Nicholas Meade, Dongchan Shin, Amirhossein Kazemnejad, Gaurav Kamath, Marius Mosbach, Karolina Stanczak, Siva Reddy
2025	—	`conf`	SHADES: Towards a Multilingual Assessment of Stereotypes in Large Language Models. NAACL (Long Papers) Margaret Mitchell, Giuseppe Attanasio, Ioana Baldini, Miruna Clinciu, Jordan Clive, Pieter Delobelle, Manan Dey, Sil Hamilton, Timm Dill, Jad Doughman, Ritam Dutt, Avijit Ghosh, Jessica Zosa Forde, Carolin Holtermann, Lucie-Aimée Kaffee, Tanmay Laud, Anne Lauscher, Roberto L. Lopez-Davila, Maraim Masoud, Nikita Nangia, Anaelia Ovalle, Giada Pistilli, Dragomir Radev, Beatrice Savoldi, Vipul Raheja, Jeremy Qin, Esther Ploeger, Arjun Subramonian, Kaustubh D. Dhole, Kaiser Sun, Amirbek Djanibekov, Jonibek Mansurov, Kayo Yin, Emilio Villa Cueva, Sagnik Mukherjee, Jerry Huang, Xudong Shen, Jay Gala, Hamdan Al-Ali, Tair Djanibekov, Nurdaulet Mukhituly, Shangrui Nie, Shanya Sharma, Karolina Stanczak, Eliza Szczechla, Tiago Timponi Torrent, Deepak Tunuguntla, Marcelo Viridiano, Oskar van der Wal, Adina Yakefu, Aurélie Névéol, Mike Zhang, Sydney Zink, Zeerak Talat
2025	A*	`conf`	SafeArena: Evaluating the Safety of Autonomous Web Agents. ICML Ada Defne Tur, Nicholas Meade, Xing Han Lù, Alejandra Zambrano, Arkil Patel, Esin Durmus, Spandana Gella, Karolina Stanczak, Siva Reddy
2025	J	`jnl`	SafeArena: Evaluating the Safety of Autonomous Web Agents. CoRR Ada Defne Tur, Nicholas Meade, Xing Han Lù, Alejandra Zambrano, Arkil Patel, Esin Durmus, Spandana Gella, Karolina Stanczak, Siva Reddy
2025	J	`jnl`	Societal Alignment Frameworks Can Improve LLM Alignment. CoRR Karolina Stanczak, Nicholas Meade, Mehar Bhatia, Hattie Zhou, Konstantin Böttinger, Jeremy Barnes, Jason Stanley, Jessica Montgomery, Richard S. Zemel, Nicolas Papernot, Nicolas Chapados, Denis Therien, Timothy P. Lillicrap, Ana Marasovic, Sylvie Delacroix, Gillian K. Hadfield, Siva Reddy
2025	J	`jnl`	Value Drifts: Tracing Value Alignment During LLM Post-Training. CoRR Mehar Bhatia, Shravan Nayak, Gaurav Kamath, Marius Mosbach, Karolina Stanczak, Vered Shwartz, Siva Reddy
2024	J	`jnl`	A Multilingual Perspective on Probing Gender Bias. CoRR Karolina Stanczak
2024	A*	`conf`	Benchmarking Vision Language Models for Cultural Understanding. EMNLP Shravan Nayak, Kanishk Jain, Rabiul Awal, Siva Reddy, Sjoerd van Steenkiste, Lisa Anne Hendricks, Karolina Stanczak, Aishwarya Agrawal
2024	J	`jnl`	Benchmarking Vision Language Models for Cultural Understanding. CoRR Shravan Nayak, Kanishk Jain, Rabiul Awal, Siva Reddy, Sjoerd van Steenkiste, Lisa Anne Hendricks, Karolina Stanczak, Aishwarya Agrawal
2024	A*	`conf`	Social Bias Probing: Fairness Benchmarking for Language Models. EMNLP Marta Marchiori Manerba, Karolina Stanczak, Riccardo Guidotti, Isabelle Augenstein
2023	A*	`conf`	A Latent-Variable Model for Intrinsic Probing. AAAI Karolina Stanczak, Lucas Torroba Hennigen, Adina Williams, Ryan Cotterell, Isabelle Augenstein
2023	J	`jnl`	Grammatical Gender's Influence on Distributional Semantics: A Causal Perspective. CoRR Karolina Stanczak, Kevin Du, Adina Williams, Isabelle Augenstein, Ryan Cotterell
2023	J	`jnl`	Invisible Women in Digital Diplomacy: A Multidimensional Framework for Online Gender Bias Against Women Ambassadors Worldwide. CoRR Yevgeniy Golovchenko, Karolina Stanczak, Rebecca Adler-Nissen, Patrice Wangen, Isabelle Augenstein
2023	J	`jnl`	Measuring Gender Bias in West Slavic Language Models. CoRR Sandra Martinková, Karolina Stanczak, Isabelle Augenstein
2023	—	`conf`	Measuring Intersectional Biases in Historical Documents. ACL (Findings) Nadav Borenstein, Karolina Stanczak, Thea Rolskov, Natacha Klein Käfer, Natalia da Silva Perez, Isabelle Augenstein
2023	J	`jnl`	Measuring Intersectional Biases in Historical Documents. CoRR Nadav Borenstein, Karolina Stanczak, Thea Rolskov, Natalia da Silva Perez, Natacha Klein Käfer, Isabelle Augenstein
2023	J	`jnl`	Social Bias Probing: Fairness Benchmarking for Language Models. CoRR Marta Marchiori Manerba, Karolina Stanczak, Riccardo Guidotti, Isabelle Augenstein
2022	J	`jnl`	A Latent-Variable Model for Intrinsic Probing. CoRR Karolina Stanczak, Lucas Torroba Hennigen, Adina Williams, Ryan Cotterell, Isabelle Augenstein
2022	—	`conf`	Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Models. NAACL-HLT Karolina Stanczak, Edoardo M. Ponti, Lucas Torroba Hennigen, Ryan Cotterell, Isabelle Augenstein
2022	J	`jnl`	Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Models. CoRR Karolina Stanczak, Edoardo Maria Ponti, Lucas Torroba Hennigen, Ryan Cotterell, Isabelle Augenstein
2021	J	`jnl`	A Survey on Gender Bias in Natural Language Processing. CoRR Karolina Stanczak, Isabelle Augenstein
2021	J	`jnl`	Quantifying Gender Bias Towards Politicians in Cross-Lingual Language Models. CoRR Karolina Stanczak, Sagnik Ray Choudhury, Tiago Pimentel, Ryan Cotterell, Isabelle Augenstein
2021	J	`jnl`	Quantifying Gender Biases Towards Politicians on Reddit. CoRR Sara Marjanovic, Karolina Stanczak, Isabelle Augenstein