Saku Sugawara

71 papers A* 12A 1B 5C 2Journal 36Unranked 15
YearRankTypeTitle / Venue / Authors
2026 J jnl
CxMP: A Linguistic Minimal-Pair Benchmark for Evaluating Constructional Understanding in Language Models.
CoRR
Miyu Oba, Saku Sugawara
2026 J jnl
Inducing Grammatical Knowledge from Indirect Evidence in Language Models.
J. Nat. Lang. Process.
Miyu Oba, Yohei Oseki, Akiyo Fukatsu, Akari Haga, Hiroki Ouchi, Taro Watanabe, Saku Sugawara
2026 — conf
Seeing the Reasoning: How LLM Rationales Influence User Trust and Decision-Making in Factual Verification Tasks.
CHI Extended Abstracts
Xin Sun, Shu Wei, Jos A. Bosch, Isao Echizen, Saku Sugawara, Abdallah El Ali
2026 J jnl
Seeing the Reasoning: How LLM Rationales Influence User Trust and Decision-Making in Factual Verification Tasks.
CoRR
Xin Sun, Shu Wei, Jos A. Bosch, Isao Echizen, Saku Sugawara, Abdallah El Ali
2026 J jnl
Which Feedback Works for Whom? Differential Effects of LLM-Generated Feedback Elements Across Learner Profiles.
CoRR
Momoka Furuhashi, Kouta Nakayama, Noboru Kawai, Takashi Kodama, Saku Sugawara, Kyosuke Takami
2025 A* conf
Are Checklists Really Useful for Automatic Evaluation of Generative Tasks?
EMNLP
Momoka Furuhashi, Kouta Nakayama, Takashi Kodama, Saku Sugawara
2025 J jnl
Are Checklists Really Useful for Automatic Evaluation of Generative Tasks?
CoRR
Momoka Furuhashi, Kouta Nakayama, Takashi Kodama, Saku Sugawara
2025 J jnl
Automatic Feedback Generation for Short Answer Questions using Answer Diagnostic Graphs.
CoRR
Momoka Furuhashi, Hiroaki Funayama, Yuya Iwase, Yuichiroh Matsubayashi, Yoriko Isobe, Toru Nagahama, Saku Sugawara, Kentaro Inui
2025 B conf
Development of Numerical Error Detection Tasks to Analyze the Numerical Capabilities of Language Models.
COLING
Taku Sakamoto, Saku Sugawara, Akiko Aizawa
2025 B conf
Measuring Human Involvement in AI-Generated Text: A Case Study on Academic Writing.
IJCNN
Yuchen Guo, Zhicheng Dou, Huy H. Nguyen, Ching-Chun Chang, Saku Sugawara, Isao Echizen
2025 J jnl
Measuring Human Involvement in AI-Generated Text: A Case Study on Academic Writing.
CoRR
Yuchen Guo, Zhicheng Dou, Huy H. Nguyen, Ching-Chun Chang, Saku Sugawara, Isao Echizen
2025 A* conf
Quality Text, Robust Vision: The Role of Language in Enhancing Visual Robustness of Vision-Language Models.
ACM Multimedia
Futa Waseda, Saku Sugawara, Isao Echizen
2025 J jnl
Quality Text, Robust Vision: The Role of Language in Enhancing Visual Robustness of Vision-Language Models.
CoRR
Futa Waseda, Saku Sugawara, Isao Echizen
2025 J jnl
Specification-Aware Machine Translation and Evaluation for Purpose Alignment.
CoRR
Yoko Kayano, Saku Sugawara
2025 J jnl
TactfulToM: Do LLMs Have the Theory of Mind Ability to Understand White Lies?
CoRR
Yiwei Liu, Emma Jane Pretty, Jiahao Huang, Saku Sugawara
2025 A* conf
TactfulToM: Do LLMs have the Theory of Mind ability to understand White Lies?
EMNLP
Yiwei Liu, Emma Jane Pretty, Jiahao Huang, Saku Sugawara
2024 A* conf
Can Language Models Induce Grammatical Knowledge from Indirect Evidence?
EMNLP
Miyu Oba, Yohei Oseki, Akiyo Fukatsu, Akari Haga, Hiroki Ouchi, Taro Watanabe, Saku Sugawara
2024 J jnl
Can Language Models Induce Grammatical Knowledge from Indirect Evidence?
CoRR
Miyu Oba, Yohei Oseki, Akiyo Fukatsu, Akari Haga, Hiroki Ouchi, Taro Watanabe, Saku Sugawara
2024 J jnl
LLM-jp: A Cross-organizational Project for the Research and Development of Fully Open Japanese LLMs.
CoRR
Akiko Aizawa, Eiji Aramaki, Bowen Chen, Fei Cheng, Hiroyuki Deguchi, Rintaro Enomoto, Kazuki Fujii, Kensuke Fukumoto, Takuya Fukushima, Namgi Han, Yuto Harada, Chikara Hashimoto, Tatsuya Hiraoka, Shohei Hisada, Sosuke Hosokawa, Lu Jie, Keisuke Kamata, Teruhito Kanazawa, Hiroki Kanezashi, Hiroshi Kataoka, Satoru Katsumata, Daisuke Kawahara, Seiya Kawano, Atsushi Keyaki, Keisuke Kiryu, Hirokazu Kiyomaru, Takashi Kodama, Takahiro Kubo, Yohei Kuga, Ryoma Kumon, Shuhei Kurita, Sadao Kurohashi, Conglong Li, Taiki Maekawa, Hiroshi Matsuda, Yusuke Miyao, Kentaro Mizuki, Sakae Mizuki, Yugo Murawaki, Ryo Nakamura, Taishi Nakamura, Kouta Nakayama, Tomoka Nakazato, Takuro Niitsuma, Jiro Nishitoba, Yusuke Oda, Hayato Ogawa, Takumi Okamoto, Naoaki Okazaki, Yohei Oseki, Shintaro Ozaki, Koki Ryu, Rafal Rzepka, Keisuke Sakaguchi, Shota Sasaki, Satoshi Sekine, Kohei Suda, Saku Sugawara, Issa Sugiura, Hiroaki Sugiyama, Hisami Suzuki, Jun Suzuki, Toyotaro Suzumura, Kensuke Tachibana, Yu Takagi, Kyosuke Takami, Koichi Takeda, Masashi Takeshita, Masahiro Tanaka, Kenjiro Taura, Arseny Tolmachev, Nobuhiro Ueda, Zhen Wan, Shuntaro Yada, Sakiko Yahata, Yuya Yamamoto, Yusuke Yamauchi, Hitomi Yanaka, Rio Yokota, Koichiro Yoshino
2024 — conf
Modeling Overregularization in Children with Small Language Models.
ACL (Findings)
Akari Haga, Saku Sugawara, Akiyo Fukatsu, Miyu Oba, Hiroki Ouchi, Taro Watanabe, Yohei Oseki
2024 J jnl
MoreHopQA: More Than Multi-hop Reasoning.
CoRR
Julian Schnitzler, Xanh Ho, Jiahao Huang, Florian Boudin, Saku Sugawara, Akiko Aizawa
2024 A* conf
Rationale-Aware Answer Verification by Pairwise Self-Evaluation.
EMNLP
Akira Kawabata, Saku Sugawara
2024 J jnl
Rationale-Aware Answer Verification by Pairwise Self-Evaluation.
CoRR
Akira Kawabata, Saku Sugawara
2024 — conf
What Makes Language Models Good-enough?
ACL (Findings)
Daiki Asami, Saku Sugawara
2024 J jnl
What Makes Language Models Good-enough?
CoRR
Daiki Asami, Saku Sugawara
2023 — conf
Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answering.
EACL (Findings)
Xanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara, Akiko Aizawa
2023 J jnl
Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answering.
CoRR
Xanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara, Akiko Aizawa
2023 A* conf
Evaluating the Rationale Understanding of Critical Reasoning in Logical Reading Comprehension.
EMNLP
Akira Kawabata, Saku Sugawara
2023 J jnl
Evaluating the Rationale Understanding of Critical Reasoning in Logical Reading Comprehension.
CoRR
Akira Kawabata, Saku Sugawara
2023 C conf
Improving Translation of Case Descriptions into Logical Fact Formulas using LegalCaseNER.
ICAIL
May Myo Zin, Ha-Thanh Nguyen, Ken Satoh, Saku Sugawara, Fumihito Nishino
2023 C conf
Information Extraction from Lengthy Legal Contracts: Leveraging Query-Based Summarization and GPT-3.5.
JURIX
May Myo Zin, Ha-Thanh Nguyen, Ken Satoh, Saku Sugawara, Fumihito Nishino
2023 — conf
On Degrees of Freedom in Defining and Testing Natural Language Understanding.
ACL (Findings)
Saku Sugawara, Shun Tsugita
2023 J jnl
On Degrees of Freedom in Defining and Testing Natural Language Understanding.
CoRR
Saku Sugawara, Shun Tsugita
2023 B conf
PROPRES: Investigating the Projectivity of Presupposition with Various Triggers and Environments.
CoNLL
Daiki Asami, Saku Sugawara
2023 J jnl
PROPRES: Investigating the Projectivity of Presupposition with Various Triggers and Environments.
CoRR
Daiki Asami, Saku Sugawara
2023 — conf
Probing Physical Reasoning with Counter-Commonsense Context.
ACL (2)
Kazushi Kondo, Saku Sugawara, Akiko Aizawa
2023 J jnl
Probing Physical Reasoning with Counter-Commonsense Context.
CoRR
Kazushi Kondo, Saku Sugawara, Akiko Aizawa
2023 A* conf
Which Shortcut Solution Do Question Answering Models Prefer to Learn?
AAAI
Kazutoshi Shinoda, Saku Sugawara, Akiko Aizawa
2022 J jnl
A Survey on Measuring and Mitigating Reasoning Shortcuts in Machine Reading Comprehension.
CoRR
Xanh Ho, Johannes Mario Meissner, Saku Sugawara, Akiko Aizawa
2022 A* conf
Cross-Modal Similarity-Based Curriculum Learning for Image Captioning.
EMNLP
Hongkuan Zhang, Saku Sugawara, Akiko Aizawa, Lei Zhou, Ryohei Sasano, Koichi Takeda
2022 J jnl
Cross-Modal Similarity-Based Curriculum Learning for Image Captioning.
CoRR
Hongkuan Zhang, Saku Sugawara, Akiko Aizawa, Lei Zhou, Ryohei Sasano, Koichi Takeda
2022 A* conf
Debiasing Masks: A New Framework for Shortcut Mitigation in NLU.
EMNLP
Johannes Mario Meissner, Saku Sugawara, Akiko Aizawa
2022 J jnl
Debiasing Masks: A New Framework for Shortcut Mitigation in NLU.
CoRR
Johannes Mario Meissner, Saku Sugawara, Akiko N. Aizawa
2022 — conf
How Well Do Multi-hop Reading Comprehension Models Understand Date Information?
AACL/IJCNLP (2)
Xanh Ho, Saku Sugawara, Akiko Aizawa
2022 J jnl
How Well Do Multi-hop Reading Comprehension Models Understand Date Information?
CoRR
Xanh Ho, Saku Sugawara, Akiko Aizawa
2022 — conf
Interdisciplinarity Inference Using a Cross Encoder between Research Projects.
SCIS/ISIS
Teruhito Kanazawa, Hidekazu Nakawatase, Saku Sugawara, Chifumi Nishioka
2022 — conf
Look to the Right: Mitigating Relative Position Bias in Extractive Question Answering.
BlackboxNLP@EMNLP
Kazutoshi Shinoda, Saku Sugawara, Akiko Aizawa
2022 J jnl
Look to the Right: Mitigating Relative Position Bias in Extractive Question Answering.
CoRR
Kazutoshi Shinoda, Saku Sugawara, Akiko Aizawa
2022 J jnl
Penalizing Confident Predictions on Largely Perturbed Inputs Does Not Improve Out-of-Distribution Generalization in Question Answering.
CoRR
Kazutoshi Shinoda, Saku Sugawara, Akiko Aizawa
2022 B conf
Possible Stories: Evaluating Situated Commonsense Reasoning under Multiple Possible Scenarios.
COLING
Mana Ashida, Saku Sugawara
2022 J jnl
Possible Stories: Evaluating Situated Commonsense Reasoning under Multiple Possible Scenarios.
CoRR
Mana Ashida, Saku Sugawara
2022 — conf
What Makes Reading Comprehension Questions Difficult?
ACL (1)
Saku Sugawara, Nikita Nangia, Alex Warstadt, Samuel R. Bowman
2022 J jnl
What Makes Reading Comprehension Questions Difficult?
CoRR
Saku Sugawara, Nikita Nangia, Alex Warstadt, Samuel R. Bowman
2022 J jnl
Which Shortcut Solution Do Question Answering Models Prefer to Learn?
CoRR
Kazutoshi Shinoda, Saku Sugawara, Akiko Aizawa
2021 A conf
Benchmarking Machine Reading Comprehension: A Psychological Perspective.
EACL
Saku Sugawara, Pontus Stenetorp, Akiko Aizawa
2021 J jnl
Can Question Generation Debias Question Answering Models? A Case Study on Question-Context Lexical Overlap.
CoRR
Kazutoshi Shinoda, Saku Sugawara, Akiko Aizawa
2021 — conf
Embracing Ambiguity: Shifting the Training Target of NLI Models.
ACL/IJCNLP (2)
Johannes Mario Meissner, Napat Thumwanit, Saku Sugawara, Akiko Aizawa
2021 J jnl
Embracing Ambiguity: Shifting the Training Target of NLI Models.
CoRR
Johannes Mario Meissner, Napat Thumwanit, Saku Sugawara, Akiko Aizawa
2021 — conf
Improving the Robustness of QA Models to Challenge Sets with Variational Question-Answer Pair Generation.
ACL (student)
Kazutoshi Shinoda, Saku Sugawara, Akiko Aizawa
2021 — conf
What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks?
ACL/IJCNLP (1)
Nikita Nangia, Saku Sugawara, Harsh Trivedi, Alex Warstadt, Clara Vania, Samuel R. Bowman
2021 J jnl
What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks?
CoRR
Nikita Nangia, Saku Sugawara, Harsh Trivedi, Alex Warstadt, Clara Vania, Samuel R. Bowman
2020 A* conf
Assessing the Benchmarking Capacity of Machine Reading Comprehension Datasets.
AAAI
Saku Sugawara, Pontus Stenetorp, Kentaro Inui, Akiko Aizawa
2020 B conf
Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Steps.
COLING
Xanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara, Akiko Aizawa
2020 J jnl
Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Steps.
CoRR
Xanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara, Akiko Aizawa
2020 J jnl
Prerequisites for Explainable Machine Reading Comprehension: A Position Paper.
CoRR
Saku Sugawara, Pontus Stenetorp, Akiko Aizawa
2019 J jnl
Assessing the Benchmarking Capacity of Machine Reading Comprehension Datasets.
CoRR
Saku Sugawara, Pontus Stenetorp, Kentaro Inui, Akiko Aizawa
2018 A* conf
What Makes Reading Comprehension Questions Easier?
EMNLP
Saku Sugawara, Kentaro Inui, Satoshi Sekine, Akiko Aizawa
2018 J jnl
What Makes Reading Comprehension Questions Easier?
CoRR
Saku Sugawara, Kentaro Inui, Satoshi Sekine, Akiko Aizawa
2017 — conf
Evaluation Metrics for Machine Reading Comprehension: Prerequisite Skills and Readability.
ACL (1)
Saku Sugawara, Yusuke Kido, Hikaru Yokono, Akiko Aizawa
2017 A* conf
Prerequisite Skills for Reading Comprehension: Multi-Perspective Analysis of MCTest Datasets and Systems.
AAAI
Saku Sugawara, Hikaru Yokono, Akiko Aizawa
2016 — conf
Annotation and Analysis of Discourse Relations, Temporal Relations and Multi-Layered Situational Relations in Japanese Texts.
ALR@COLING
Kimi Kaneko, Saku Sugawara, Koji Mineshima, Daisuke Bekki