Faisal Ladhak

60 papers A* 7A 3B 1Journal 35Unranked 13
YearRankTypeTitle / Venue / Authors
2025 J jnl
L0-Reasoning Bench: Evaluating Procedural Correctness in Language Models via Simple Program Execution.
CoRR
Simeng Sun, Cheng-Ping Hsieh, Faisal Ladhak, Erik Arakelyan, Santiago Akle Serano, Boris Ginsburg
2025 J jnl
Many-Turn Jailbreaking.
CoRR
Xianjun Yang, Liqiang Xiao, Shiyang Li, Faisal Ladhak, Hyokun Yun, Linda Ruth Petzold, Yi Xu, William Yang Wang
2025 J jnl
SWAN-GPT: An Efficient and Scalable Approach for Long-Context Language Modeling.
CoRR
Krishna C. Puvvada, Faisal Ladhak, Santiago Akle Serrano, Cheng-Ping Hsieh, Shantanu Acharya, Somshubra Majumdar, Fei Jia, Samuel Kriman, Simeng Sun, Dima Rekesh, Boris Ginsburg
2025 A* conf
SWAN: An Efficient and Scalable Approach for Long-Context Language Modeling.
EMNLP
Krishna C. Puvvada, Faisal Ladhak, Santiago Akle Serano, Cheng-Ping Hsieh, Shantanu Acharya, Somshubra Majumdar, Fei Jia, Samuel Kriman, Simeng Sun, Dima Rekesh, Boris Ginsburg
2025 — conf
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference.
ACL (1)
Benjamin Warner, Antoine Chaffin, Benjamin Clavié, Orion Weller, Oskar Hallström, Said Taghadouini, Alexis Gallagher, Raja Biswas, Faisal Ladhak, Tom Aarsen, Griffin Thomas Adams, Jeremy Howard, Iacopo Poli
2025 J jnl
SpaceTools: Tool-Augmented Spatial Reasoning via Double Interactive RL.
CoRR
Siyi Chen, Mikaela Angelina Uy, Chan Hee Song, Faisal Ladhak, Adithyavairavan Murali, Qing Qu, Stan Birchfield, Valts Blukis, Jonathan Tremblay
2024 — conf
Aligning Large Language Models via Fine-grained Supervision.
ACL (Short Papers)
Dehong Xu, Liang Qiu, Minseok Kim, Faisal Ladhak, Jaeyoung Do
2024 J jnl
Aligning Large Language Models via Fine-grained Supervision.
CoRR
Dehong Xu, Liang Qiu, Minseok Kim, Faisal Ladhak, Jaeyoung Do
2024 J jnl
Benchmarking Large Language Models for News Summarization.
Trans. Assoc. Comput. Linguistics
Tianyi Zhang, Faisal Ladhak, Esin Durmus, Percy Liang, Kathleen R. McKeown, Tatsunori B. Hashimoto
2024 J jnl
Incorporating Human Explanations for Robust Hate Speech Detection.
CoRR
Jennifer L. Chen, Faisal Ladhak, Daniel Li, Noémie Elhadad
2024 A* conf
Proving Test Set Contamination in Black-Box Language Models.
ICLR
Yonatan Oren, Nicole Meister, Niladri S. Chatterji, Faisal Ladhak, Tatsunori Hashimoto
2024 A* conf
STORYSUMM: Evaluating Faithfulness in Story Summarization.
EMNLP
Melanie Subbiah, Faisal Ladhak, Akankshya Mishra, Griffin Adams, Lydia B. Chilton, Kathleen R. McKeown
2024 J jnl
STORYSUMM: Evaluating Faithfulness in Story Summarization.
CoRR
Melanie Subbiah, Faisal Ladhak, Akankshya Mishra, Griffin Adams, Lydia B. Chilton, Kathleen R. McKeown
2024 J jnl
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference.
CoRR
Benjamin Warner, Antoine Chaffin, Benjamin Clavié, Orion Weller, Oskar Hallström, Said Taghadouini, Alexis Gallagher, Raja Biswas, Faisal Ladhak, Tom Aarsen, Nathan Cooper, Griffin Adams, Jeremy Howard, Iacopo Poli
2023 J jnl
Benchmarking Large Language Models for News Summarization.
CoRR
Tianyi Zhang, Faisal Ladhak, Esin Durmus, Percy Liang, Kathleen R. McKeown, Tatsunori B. Hashimoto
2023 — conf
Contrastive Error Attribution for Finetuned Language Models.
ACL (1)
Faisal Ladhak, Esin Durmus, Tatsunori Hashimoto
2023 — conf
Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scale.
FAccT
Federico Bianchi, Pratyusha Kalluri, Esin Durmus, Faisal Ladhak, Myra Cheng, Debora Nozza, Tatsunori Hashimoto, Dan Jurafsky, James Zou, Aylin Caliskan
2023 J jnl
Evaluating Human-Language Model Interaction.
Trans. Mach. Learn. Res.
Mina Lee, Megha Srivastava, Amelia Hardy, John Thickstun, Esin Durmus, Ashwin Paranjape, Ines Gerard-Ursin, Xiang Lisa Li, Faisal Ladhak, Frieda Rong, Rose E. Wang, Minae Kwon, Joon Sung Park, Hancheng Cao, Tony Lee, Rishi Bommasani, Michael S. Bernstein, Percy Liang
2023 — —
Faithfulness in Abstractive Summarization: Progress and Challenges
Faisal Ladhak
2023 J jnl
From Sparse to Dense: GPT-4 Summarization with Chain of Density Prompting.
CoRR
Griffin Adams, Alexander R. Fabbri, Faisal Ladhak, Eric Lehman, Noémie Elhadad
2023 — conf
Generating EDU Extracts for Plan-Guided Summary Re-Ranking.
ACL (1)
Griffin Adams, Alexander R. Fabbri, Faisal Ladhak, Noémie Elhadad, Kathleen R. McKeown
2023 J jnl
Generating EDU Extracts for Plan-Guided Summary Re-Ranking.
CoRR
Griffin Adams, Alexander R. Fabbri, Faisal Ladhak, Kathleen R. McKeown, Noémie Elhadad
2023 J jnl
Holistic Evaluation of Language Models.
Trans. Mach. Learn. Res.
Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, Benjamin Newman, Binhang Yuan, Bobby Yan, Ce Zhang, Christian Cosgrove, Christopher D. Manning, Christopher Ré, Diana Acosta-Navas, Drew A. Hudson, Eric Zelikman, Esin Durmus, Faisal Ladhak, Frieda Rong, Hongyu Ren, Huaxiu Yao, Jue Wang, Keshav Santhanam, Laurel J. Orr, Lucia Zheng, Mert Yüksekgönül, Mirac Suzgun, Nathan Kim, Neel Guha, Niladri S. Chatterji, Omar Khattab, Peter Henderson, Qian Huang, Ryan Chi, Sang Michael Xie, Shibani Santurkar, Surya Ganguli, Tatsunori Hashimoto, Thomas Icard, Tianyi Zhang, Vishrav Chaudhary, William Wang, Xuechen Li, Yifan Mai, Yuhui Zhang, Yuta Koreeda
2023 J jnl
Proving Test Set Contamination in Black Box Language Models.
CoRR
Yonatan Oren, Nicole Meister, Niladri S. Chatterji, Faisal Ladhak, Tatsunori B. Hashimoto
2023 A conf
When Do Pre-Training Biases Propagate to Downstream Tasks? A Case Study in Text Summarization.
EACL
Faisal Ladhak, Esin Durmus, Mirac Suzgun, Tianyi Zhang, Dan Jurafsky, Kathleen R. McKeown, Tatsunori Hashimoto
2023 A* conf
Whose Opinions Do Language Models Reflect?
ICML
Shibani Santurkar, Esin Durmus, Faisal Ladhak, Cinoo Lee, Percy Liang, Tatsunori Hashimoto
2023 J jnl
Whose Opinions Do Language Models Reflect?
CoRR
Shibani Santurkar, Esin Durmus, Faisal Ladhak, Cinoo Lee, Percy Liang, Tatsunori Hashimoto
2022 J jnl
CREATIVESUMM: Shared Task on Automatic Summarization for Creative Writing.
CoRR
Divyansh Agarwal, Alexander R. Fabbri, Simeng Han, Wojciech Kryscinski, Faisal Ladhak, Bryan Li, Kathleen R. McKeown, Dragomir Radev, Tianyi Zhang, Sam Wiseman
2022 B conf
Constrained Regeneration for Cross-Lingual Query-Focused Extractive Summarization.
COLING
Elsbeth Turcan, David Wan, Faisal Ladhak, Petra Galuscáková, Sukanta Sen, Svetlana Tchistiakova, Weijia Xu, Marine Carpuat, Kenneth Heafield, Douglas W. Oard, Kathleen R. McKeown
2022 J jnl
Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scale.
CoRR
Federico Bianchi, Pratyusha Kalluri, Esin Durmus, Faisal Ladhak, Myra Cheng, Debora Nozza, Tatsunori Hashimoto, Dan Jurafsky, James Zou, Aylin Caliskan
2022 J jnl
Evaluating Human-Language Model Interaction.
CoRR
Mina Lee, Megha Srivastava, Amelia Hardy, John Thickstun, Esin Durmus, Ashwin Paranjape, Ines Gerard-Ursin, Xiang Lisa Li, Faisal Ladhak, Frieda Rong, Rose E. Wang, Minae Kwon, Joon Sung Park, Hancheng Cao, Tony Lee, Rishi Bommasani, Michael S. Bernstein, Percy Liang
2022 — conf
Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarization.
ACL (1)
Faisal Ladhak, Esin Durmus, He He, Claire Cardie, Kathleen R. McKeown
2022 J jnl
GEMv2: Multilingual NLG Benchmarking in a Single Line of Code.
CoRR
Sebastian Gehrmann, Abhik Bhattacharjee, Abinaya Mahendiran, Alex Wang, Alexandros Papangelis, Aman Madaan, Angelina McMillan-Major, Anna Shvets, Ashish Upadhyay, Bingsheng Yao, Bryan Wilie, Chandra Bhagavatula, Chaobin You, Craig Thomson, Cristina Garbacea, Dakuo Wang, Daniel Deutsch, Deyi Xiong, Di Jin, Dimitra Gkatzia, Dragomir R. Radev, Elizabeth Clark, Esin Durmus, Faisal Ladhak, Filip Ginter, Genta Indra Winata, Hendrik Strobelt, Hiroaki Hayashi, Jekaterina Novikova, Jenna Kanerva, Jenny Chim, Jiawei Zhou, Jordan Clive, Joshua Maynez, João Sedoc, Juraj Juraska, Kaustubh D. Dhole, Khyathi Raghavi Chandu, Laura Perez-Beltrachini, Leonardo F. R. Ribeiro, Lewis Tunstall, Li Zhang, Mahima Pushkarna, Mathias Creutz, Michael White, Mihir Sanjay Kale, Moussa Kamal Eddine, Nico Daheim, Nishant Subramani, Ondrej Dusek, Paul Pu Liang, Pawan Sasanka Ammanamanchi, Qi Zhu, Ratish Puduppully, Reno Kriz, Rifat Shahriyar, Ronald Cardenas, Saad Mahamood, Salomey Osei, Samuel Cahyawijaya, Sanja Stajner, Sébastien Montella, Shailza Jolly, Simon Mille, Tahmid Hasan, Tianhao Shen, Tosin P. AMahidewumi, Vikas Raunak, Vipul Raheja, Vitaly Nikolaev, Vivian Tsai, Yacine Jernite, Ying Xu, Yisi Sang, Yixin Liu, Yufang Hou
2022 J jnl
Holistic Evaluation of Language Models.
CoRR
Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, Benjamin Newman, Binhang Yuan, Bobby Yan, Ce Zhang, Christian Cosgrove, Christopher D. Manning, Christopher Ré, Diana Acosta-Navas, Drew A. Hudson, Eric Zelikman, Esin Durmus, Faisal Ladhak, Frieda Rong, Hongyu Ren, Huaxiu Yao, Jue Wang, Keshav Santhanam, Laurel J. Orr, Lucia Zheng, Mert Yüksekgönül, Mirac Suzgun, Nathan Kim, Neel Guha, Niladri S. Chatterji, Omar Khattab, Peter Henderson, Qian Huang, Ryan Chi, Sang Michael Xie, Shibani Santurkar, Surya Ganguli, Tatsunori Hashimoto, Thomas Icard, Tianyi Zhang, Vishrav Chaudhary, William Wang, Xuechen Li, Yifan Mai, Yuhui Zhang, Yuta Koreeda
2022 A* conf
Improving Faithfulness by Augmenting Negative Summaries from Fake Documents.
EMNLP
Tianshu Wang, Faisal Ladhak, Esin Durmus, He He
2022 J jnl
Novel Chapter Abstractive Summarization using Spinal Tree Aware Sub-Sentential Content Selection.
CoRR
Hardy Hardy, Miguel Ballesteros, Faisal Ladhak, Muhammad Khalifa, Vittorio Castelli, Kathleen R. McKeown
2022 — conf
Spurious Correlations in Reference-Free Evaluation of Text Generation.
ACL (1)
Esin Durmus, Faisal Ladhak, Tatsunori Hashimoto
2022 J jnl
Spurious Correlations in Reference-Free Evaluation of Text Generation.
CoRR
Esin Durmus, Faisal Ladhak, Tatsunori Hashimoto
2022 A* conf
ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detection.
EMNLP
Badr AlKhamissi, Faisal Ladhak, Srini Iyer, Veselin Stoyanov, Zornitsa Kozareva, Xian Li, Pascale Fung, Lambert Mathias, Asli Celikyilmaz, Mona T. Diab
2022 J jnl
ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detection.
CoRR
Badr AlKhamissi, Faisal Ladhak, Srini Iyer, Ves Stoyanov, Zornitsa Kozareva, Xian Li, Pascale Fung, Lambert Mathias, Asli Celikyilmaz, Mona T. Diab
2022 J jnl
Tracing and Removing Data Errors in Natural Language Generation Datasets.
CoRR
Faisal Ladhak, Esin Durmus, Tatsunori Hashimoto
2021 J jnl
Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarization.
CoRR
Faisal Ladhak, Esin Durmus, He He, Claire Cardie, Kathleen R. McKeown
2021 A conf
Segmenting Subtitles for Correcting ASR Segmentation Errors.
EACL
David Wan, Chris Kedzie, Faisal Ladhak, Elsbeth Turcan, Petra Galuscáková, Elena Zotkina, Zhengping Jiang, Peter Bell, Kathleen R. McKeown
2021 J jnl
Segmenting Subtitles for Correcting ASR Segmentation Errors.
CoRR
David Wan, Chris Kedzie, Faisal Ladhak, Elsbeth Turcan, Petra Galuscáková, Elena Zotkina, Zhengping Jiang, Peter Bell, Kathleen R. McKeown
2021 J jnl
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics.
CoRR
Sebastian Gehrmann, Tosin P. Adewumi, Karmanya Aggarwal, Pawan Sasanka Ammanamanchi, Aremu Anuoluwapo, Antoine Bosselut, Khyathi Raghavi Chandu, Miruna-Adriana Clinciu, Dipanjan Das, Kaustubh D. Dhole, Wanyu Du, Esin Durmus, Ondrej Dusek, Chris Emezue, Varun Gangal, Cristina Garbacea, Tatsunori Hashimoto, Yufang Hou, Yacine Jernite, Harsh Jhamtani, Yangfeng Ji, Shailza Jolly, Dhruv Kumar, Faisal Ladhak, Aman Madaan, Mounica Maddela, Khyati Mahajan, Saad Mahamood, Bodhisattwa Prasad Majumder, Pedro Henrique Martins, Angelina McMillan-Major, Simon Mille, Emiel van Miltenburg, Moin Nadeem, Shashi Narayan, Vitaly Nikolaev, Rubungo Andre Niyongabo, Salomey Osei, Ankur P. Parikh, Laura Perez-Beltrachini, Niranjan Ramesh Rao, Vikas Raunak, Juan Diego Rodriguez, Sashank Santhanam, João Sedoc, Thibault Sellam, Samira Shaikh, Anastasia Shimorina, Marco Antonio Sobrevilla Cabezudo, Hendrik Strobelt, Nishant Subramani, Wei Xu, Diyi Yang, Akhila Yerukola, Jiawei Zhou
2020 A* conf
Exploring Content Selection in Summarization of Novel Chapters.
ACL
Faisal Ladhak, Bryan Li, Yaser Al-Onaizan, Kathleen R. McKeown
2020 J jnl
Exploring Content Selection in Summarization of Novel Chapters.
CoRR
Faisal Ladhak, Bryan Li, Yaser Al-Onaizan, Kathleen R. McKeown
2020 — conf
Incorporating Terminology Constraints in Automatic Post-Editing.
WMT@EMNLP
David Wan, Chris Kedzie, Faisal Ladhak, Marine Carpuat, Kathleen R. McKeown
2020 J jnl
Incorporating Terminology Constraints in Automatic Post-Editing.
CoRR
David Wan, Chris Kedzie, Faisal Ladhak, Marine Carpuat, Kathleen R. McKeown
2020 J jnl
The Role of Pragmatic and Discourse Context in Determining Argument Impact.
CoRR
Esin Durmus, Faisal Ladhak, Claire Cardie
2020 — conf
To BERT or Not to BERT: Comparing Task-specific and Task-agnostic Semi-Supervised Approaches for Sequence Tagging.
EMNLP (1)
Kasturi Bhattacharjee, Miguel Ballesteros, Rishita Anubhai, Smaranda Muresan, Jie Ma, Faisal Ladhak, Yaser Al-Onaizan
2020 J jnl
To BERT or Not to BERT: Comparing Task-specific and Task-agnostic Semi-Supervised Approaches for Sequence Tagging.
CoRR
Kasturi Bhattacharjee, Miguel Ballesteros, Rishita Anubhai, Smaranda Muresan, Jie Ma, Faisal Ladhak, Yaser Al-Onaizan
2020 J jnl
WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarization.
CoRR
Faisal Ladhak, Esin Durmus, Claire Cardie, Kathleen R. McKeown
2020 — conf
WikiLingua: A New Benchmark Dataset for Multilingual Abstractive Summarization.
EMNLP (Findings)
Faisal Ladhak, Esin Durmus, Claire Cardie, Kathleen R. McKeown
2019 — conf
Determining Relative Argument Specificity and Stance for Complex Argumentative Structures.
ACL (1)
Esin Durmus, Faisal Ladhak, Claire Cardie
2019 J jnl
Determining Relative Argument Specificity and Stance for Complex Argumentative Structures.
CoRR
Esin Durmus, Faisal Ladhak, Claire Cardie
2019 — conf
The Role of Pragmatic and Discourse Context in Determining Argument Impact.
EMNLP/IJCNLP (1)
Esin Durmus, Faisal Ladhak, Claire Cardie
2018 — conf
A neural interlingua for multilingual machine translation.
WMT
Yichao Lu, Phillip Keung, Faisal Ladhak, Vikas Bhardwaj, Shaonan Zhang, Jason Sun
2018 J jnl
A neural interlingua for multilingual machine translation.
CoRR
Yichao Lu, Phillip Keung, Faisal Ladhak, Vikas Bhardwaj, Shaonan Zhang, Jason Sun
2016 A conf
LatticeRnn: Recurrent Neural Networks Over Lattices.
INTERSPEECH
Faisal Ladhak, Ankur Gandhe, Markus Dreyer, Lambert Mathias, Ariya Rastrow, Björn Hoffmeister