Hayato Futami

50 papers A 11C 2Misc 7Journal 27Unranked 3
YearRankTypeTitle / Venue / Authors
2026 J jnl
Optimizing Conversational Quality in Spoken Dialogue Systems with Reinforcement Learning from AI Feedback.
CoRR
Siddhant Arora, Jinchuan Tian, Jiatong Shi, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2026 J jnl
Phonological Tokenizer: Prosody-Aware Phonetic Token via Multi-Objective Fine-Tuning with Differentiable K-Means.
CoRR
Kentaro Onda, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2025 J jnl
Chain-of-Thought Reasoning in Streaming Full-Duplex End-to-End Spoken Dialogue Systems.
CoRR
Siddhant Arora, Jinchuan Tian, Hayato Futami, Jiatong Shi, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2025 A conf
Chain-of-Thought Training for Open E2E Spoken Dialogue Systems.
INTERSPEECH
Siddhant Arora, Jinchuan Tian, Hayato Futami, Jee-weon Jung, Jiatong Shi, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2025 J jnl
Chain-of-Thought Training for Open E2E Spoken Dialogue Systems.
CoRR
Siddhant Arora, Jinchuan Tian, Hayato Futami, Jee-weon Jung, Jiatong Shi, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2025 A conf
Differentiable K-means for Fully-optimized Discrete Token-based ASR.
INTERSPEECH
Kentaro Onda, Yosuke Kashiwagi, Emiru Tsunoo, Hayato Futami, Shinji Watanabe
2025 J jnl
Differentiable K-means for Fully-optimized Discrete Token-based ASR.
CoRR
Kentaro Onda, Yosuke Kashiwagi, Emiru Tsunoo, Hayato Futami, Shinji Watanabe
2025 — conf
ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systems.
NAACL (System Demonstrations)
Siddhant Arora, Yifan Peng, Jiatong Shi, Jinchuan Tian, William Chen, Shikhar Bharadwaj, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Shuichiro Shimizu, Vaibhav Srivastav, Shinji Watanabe
2025 J jnl
ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systems.
CoRR
Siddhant Arora, Yifan Peng, Jiatong Shi, Jinchuan Tian, William Chen, Shikhar Bharadwaj, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Shuichiro Shimizu, Vaibhav Srivastav, Shinji Watanabe
2025 — conf
Exploring Context Strategies in LLMs for Discourse-Aware Machine Translation.
EMNLP (Findings)
Ritvik Choudhary, Rem Hida, Masaki Hamada, Hayato Futami, Toshiyuki Sekiya
2025 Misc conf
Hypothesis Clustering and Merging: Novel MultiTalker Speech Recognition with Speaker Tokens.
ICASSP
Yosuke Kashiwagi, Hayato Futami, Emiru Tsunoo, Siddhant Arora, Shinji Watanabe
2025 A conf
Scheduled Interleaved Speech-Text Training for Speech-to-Speech Translation with LLMs.
INTERSPEECH
Hayato Futami, Emiru Tsunoo, Yosuke Kashiwagi, Yuki Ito, Hassan Shahmohammadi, Siddhant Arora, Shinji Watanabe
2025 J jnl
Scheduled Interleaved Speech-Text Training for Speech-to-Speech Translation with LLMs.
CoRR
Hayato Futami, Emiru Tsunoo, Yosuke Kashiwagi, Yuki Ito, Hassan Shahmohammadi, Siddhant Arora, Shinji Watanabe
2025 C conf
Spiralformer: Low Latency Encoder for Streaming Speech Recognition with Circular Layer Skipping and Early Exiting.
ASRU
Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe
2025 J jnl
Spiralformer: Low Latency Encoder for Streaming Speech Recognition with Circular Layer Skipping and Early Exiting.
CoRR
Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe
2025 J jnl
Whale: Large-Scale multilingual ASR model with w2v-BERT and E-Branchformer with large speech data.
CoRR
Yosuke Kashiwagi, Hayato Futami, Emiru Tsunoo, Satoshi Asakawa
2024 A conf
Decoder-only Architecture for Streaming End-to-end Speech Recognition.
INTERSPEECH
Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe
2024 J jnl
Decoder-only Architecture for Streaming End-to-end Speech Recognition.
CoRR
Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe
2024 A conf
Finding Task-specific Subnetworks in Multi-task Spoken Language Understanding Model.
INTERSPEECH
Hayato Futami, Siddhant Arora, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2024 J jnl
Finding Task-specific Subnetworks in Multi-task Spoken Language Understanding Model.
CoRR
Hayato Futami, Siddhant Arora, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2024 J jnl
Hypothesis Clustering and Merging: Novel MultiTalker Speech Recognition with Speaker Tokens.
CoRR
Yosuke Kashiwagi, Hayato Futami, Emiru Tsunoo, Siddhant Arora, Shinji Watanabe
2024 Misc conf
Phoneme-Aware Encoding for Prefix-Tree-Based Contextual ASR.
ICASSP
Hayato Futami, Emiru Tsunoo, Yosuke Kashiwagi, Hiroaki Ogawa, Siddhant Arora, Shinji Watanabe
2024 A conf
Rapid Language Adaptation for Multilingual E2E Speech Recognition Using Encoder Prompting.
INTERSPEECH
Yosuke Kashiwagi, Hayato Futami, Emiru Tsunoo, Siddhant Arora, Shinji Watanabe
2024 J jnl
Rapid Language Adaptation for Multilingual E2E Speech Recognition Using Encoder Prompting.
CoRR
Yosuke Kashiwagi, Hayato Futami, Emiru Tsunoo, Siddhant Arora, Shinji Watanabe
2024 J jnl
Task Arithmetic for Language Expansion in Speech Translation.
CoRR
Yao-Fei Cheng, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Wen Shen Teo, Siddhant Arora, Shinji Watanabe
2024 — conf
UniverSLU: Universal Spoken Language Understanding for Diverse Tasks with Natural Language Instructions.
NAACL-HLT
Siddhant Arora, Hayato Futami, Jee-weon Jung, Yifan Peng, Roshan S. Sharma, Yosuke Kashiwagi, Emiru Tsunoo, Karen Livescu, Shinji Watanabe
2023 Misc conf
A Study on the Integration of Pipeline and E2E SLU Systems for Spoken Semantic Parsing Toward Stop Quality Challenge.
ICASSP
Siddhant Arora, Hayato Futami, Shih-Lun Wu, Jessica Huynh, Yifan Peng, Yosuke Kashiwagi, Emiru Tsunoo, Brian Yan, Shinji Watanabe
2023 J jnl
A Study on the Integration of Pipeline and E2E SLU systems for Spoken Semantic Parsing toward STOP Quality Challenge.
CoRR
Siddhant Arora, Hayato Futami, Shih-Lun Wu, Jessica Huynh, Yifan Peng, Yosuke Kashiwagi, Emiru Tsunoo, Brian Yan, Shinji Watanabe
2023 J jnl
Decoder-only Architecture for Speech Recognition with CTC Prompts and Text Data Augmentation.
CoRR
Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe
2023 Misc conf
E-Branchformer-Based E2E SLU Toward Stop on-Device Challenge.
ICASSP
Yosuke Kashiwagi, Siddhant Arora, Hayato Futami, Jessica Huynh, Shih-Lun Wu, Yifan Peng, Brian Yan, Emiru Tsunoo, Shinji Watanabe
2023 A conf
Integrating Pretrained ASR and LM to Perform Sequence Generation for Spoken Language Understanding.
INTERSPEECH
Siddhant Arora, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Brian Yan, Shinji Watanabe
2023 J jnl
Integrating Pretrained ASR and LM to Perform Sequence Generation for Spoken Language Understanding.
CoRR
Siddhant Arora, Hayato Futami, Yosuke Kashiwagi, Emiru Tsunoo, Brian Yan, Shinji Watanabe
2023 A conf
Integration of Frame- and Label-synchronous Beam Search for Streaming Encoder-decoder Speech Recognition.
INTERSPEECH
Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe
2023 J jnl
Integration of Frame- and Label-synchronous Beam Search for Streaming Encoder-decoder Speech Recognition.
CoRR
Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe
2023 Misc conf
Joint Modelling of Spoken Language Understanding Tasks with Integrated Dialog History.
ICASSP
Siddhant Arora, Hayato Futami, Emiru Tsunoo, Brian Yan, Shinji Watanabe
2023 J jnl
Joint Modelling of Spoken Language Understanding Tasks with Integrated Dialog History.
CoRR
Siddhant Arora, Hayato Futami, Emiru Tsunoo, Brian Yan, Shinji Watanabe
2023 J jnl
Phoneme-aware Encoding for Prefix-tree-based Contextual ASR.
CoRR
Hayato Futami, Emiru Tsunoo, Yosuke Kashiwagi, Hiroaki Ogawa, Siddhant Arora, Shinji Watanabe
2023 Misc conf
Streaming Joint Speech Recognition and Disfluency Detection.
ICASSP
Hayato Futami, Emiru Tsunoo, Kentaro Shibata, Yosuke Kashiwagi, Takao Okuda, Siddhant Arora, Shinji Watanabe
2023 A conf
Tensor decomposition for minimization of E2E SLU model toward on-device processing.
INTERSPEECH
Yosuke Kashiwagi, Siddhant Arora, Hayato Futami, Jessica Huynh, Shih-Lun Wu, Yifan Peng, Brian Yan, Emiru Tsunoo, Shinji Watanabe
2023 J jnl
The Pipeline System of ASR and NLU with MLM-based Data Augmentation toward STOP Low-resource Challenge.
CoRR
Hayato Futami, Jessica Huynh, Siddhant Arora, Shih-Lun Wu, Yosuke Kashiwagi, Yifan Peng, Brian Yan, Emiru Tsunoo, Shinji Watanabe
2023 Misc conf
The Pipeline System of ASR and NLU with MLM-based data Augmentation Toward Stop Low-Resource Challenge.
ICASSP
Hayato Futami, Jessica Huynh, Siddhant Arora, Shih-Lun Wu, Yosuke Kashiwagi, Yifan Peng, Brian Yan, Emiru Tsunoo, Shinji Watanabe
2023 J jnl
UniverSLU: Universal Spoken Language Understanding for Diverse Classification and Sequence Generation Tasks with a Single Network.
CoRR
Siddhant Arora, Hayato Futami, Jee-weon Jung, Yifan Peng, Roshan S. Sharma, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
2022 J jnl
Distilling the Knowledge of BERT for CTC-based ASR.
CoRR
Hayato Futami, Hirofumi Inaguma, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara
2022 A conf
Non-autoregressive Error Correction for CTC-based ASR with Phone-conditioned Masked LM.
INTERSPEECH
Hayato Futami, Hirofumi Inaguma, Sei Ueno, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara
2022 J jnl
Non-autoregressive Error Correction for CTC-based ASR with Phone-conditioned Masked LM.
CoRR
Hayato Futami, Hirofumi Inaguma, Sei Ueno, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara
2022 J jnl
Streaming Joint Speech Recognition and Disfluency Detection.
CoRR
Hayato Futami, Emiru Tsunoo, Kentaro Shibata, Yosuke Kashiwagi, Takao Okuda, Siddhant Arora, Shinji Watanabe
2021 J jnl
ASR Rescoring and Confidence Estimation with ELECTRA.
CoRR
Hayato Futami, Hirofumi Inaguma, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara
2021 C conf
ASR Rescoring and Confidence Estimation with Electra.
ASRU
Hayato Futami, Hirofumi Inaguma, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara
2020 A conf
Distilling the Knowledge of BERT for Sequence-to-Sequence ASR.
INTERSPEECH
Hayato Futami, Hirofumi Inaguma, Sei Ueno, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara
2020 J jnl
Distilling the Knowledge of BERT for Sequence-to-Sequence ASR.
CoRR
Hayato Futami, Hirofumi Inaguma, Sei Ueno, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara