Sumit Sanghai

25 papers A* 6A 1B 1Journal 14Unranked 3
YearRankTypeTitle / Venue / Authors
2024 A* conf
Functional Interpolation for Relative Positions improves Long Context Transformers.
ICLR
Shanda Li, Chong You, Guru Guruganesh, Joshua Ainslie, Santiago Ontañón, Manzil Zaheer, Sumit Sanghai, Yiming Yang, Sanjiv Kumar, Srinadh Bhojanapalli
2024 J jnl
Integrating Planning into Single-Turn Long-Form Text Generation.
CoRR
Yi Liang, You Wu, Honglei Zhuang, Li Chen, Jiaming Shen, Yiling Jia, Zhen Qin, Sumit Sanghai, Xuanhui Wang, Carl Yang, Michael Bendersky
2024 — conf
MEMORY-VQ: Compression for Tractable Internet-Scale Memory.
NAACL (Short Papers)
Yury Zemlyanskiy, Michiel de Jong, Luke Vilnis, Santiago Ontañón, William W. Cohen, Sumit Sanghai, Joshua Ainslie
2023 A* conf
Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models.
ICML
Luke Vilnis, Yury Zemlyanskiy, Patrick Murray, Alexandre Tachard Passos, Sumit Sanghai
2023 A* conf
CoLT5: Faster Long-Range Transformers with Conditional Computation.
EMNLP
Joshua Ainslie, Tao Lei, Michiel de Jong, Santiago Ontañón, Siddhartha Brahma, Yury Zemlyanskiy, David C. Uthus, Mandy Guo, James Lee-Thorp, Yi Tay, Yun-Hsuan Sung, Sumit Sanghai
2023 J jnl
CoLT5: Faster Long-Range Transformers with Conditional Computation.
CoRR
Joshua Ainslie, Tao Lei, Michiel de Jong, Santiago Ontañón, Siddhartha Brahma, Yury Zemlyanskiy, David C. Uthus, Mandy Guo, James Lee-Thorp, Yi Tay, Yun-Hsuan Sung, Sumit Sanghai
2023 — conf
FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference.
ACL (Findings)
Michiel de Jong, Yury Zemlyanskiy, Joshua Ainslie, Nicholas FitzGerald, Sumit Sanghai, Fei Sha, William W. Cohen
2023 J jnl
Functional Interpolation for Relative Positions Improves Long Context Transformers.
CoRR
Shanda Li, Chong You, Guru Guruganesh, Joshua Ainslie, Santiago Ontañón, Manzil Zaheer, Sumit Sanghai, Yiming Yang, Sanjiv Kumar, Srinadh Bhojanapalli
2023 J jnl
GLIMMER: generalized late-interaction memory reranker.
CoRR
Michiel de Jong, Yury Zemlyanskiy, Nicholas FitzGerald, Sumit Sanghai, William W. Cohen, Joshua Ainslie
2023 A* conf
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints.
EMNLP
Joshua Ainslie, James Lee-Thorp, Michiel de Jong, Yury Zemlyanskiy, Federico Lebrón, Sumit Sanghai
2023 J jnl
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints.
CoRR
Joshua Ainslie, James Lee-Thorp, Michiel de Jong, Yury Zemlyanskiy, Federico Lebrón, Sumit Sanghai
2023 J jnl
MEMORY-VQ: Compression for Tractable Internet-Scale Memory.
CoRR
Yury Zemlyanskiy, Michiel de Jong, Luke Vilnis, Santiago Ontañón, William W. Cohen, Sumit Sanghai, Joshua Ainslie
2023 A* conf
Pre-computed memory or on-the-fly encoding? A hybrid approach to retrieval augmentation makes the most of your compute.
ICML
Michiel de Jong, Yury Zemlyanskiy, Nicholas FitzGerald, Joshua Ainslie, Sumit Sanghai, Fei Sha, William W. Cohen
2023 J jnl
Pre-computed memory or on-the-fly encoding? A hybrid approach to retrieval augmentation makes the most of your compute.
CoRR
Michiel de Jong, Yury Zemlyanskiy, Nicholas FitzGerald, Joshua Ainslie, Sumit Sanghai, Fei Sha, William W. Cohen
2022 J jnl
Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models.
CoRR
Luke Vilnis, Yury Zemlyanskiy, Patrick Murray, Alexandre Passos, Sumit Sanghai
2022 J jnl
FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference.
CoRR
Michiel de Jong, Yury Zemlyanskiy, Joshua Ainslie, Nicholas FitzGerald, Sumit Sanghai, Fei Sha, William W. Cohen
2022 B conf
Generate-and-Retrieve: Use Your Predictions to Improve Retrieval for Semantic Parsing.
COLING
Yury Zemlyanskiy, Michiel de Jong, Joshua Ainslie, Panupong Pasupat, Peter Shaw, Linlu Qiu, Sumit Sanghai, Fei Sha
2022 J jnl
Generate-and-Retrieve: use your predictions to improve retrieval for semantic parsing.
CoRR
Yury Zemlyanskiy, Michiel de Jong, Joshua Ainslie, Panupong Pasupat, Peter Shaw, Linlu Qiu, Sumit Sanghai, Fei Sha
2022 J jnl
ImPaKT: A Dataset for Open-Schema Knowledge Base Construction.
CoRR
Luke Vilnis, Zachary Fisher, Bhargav Kanagal, Patrick Murray, Sumit Sanghai
2022 A conf
MAVE: A Product Dataset for Multi-source Attribute Value Extraction.
WSDM
Li Yang, Qifan Wang, Zac Yu, Anand Kulkarni, Sumit Sanghai, Bin Shu, Jon Elsas, Bhargav Kanagal
2021 J jnl
MAVE: A Product Dataset for Multi-source Attribute Value Extraction.
CoRR
Li Yang, Qifan Wang, Zac Yu, Anand Kulkarni, Sumit Sanghai, Bin Shu, Jon Elsas, Bhargav Kanagal
2021 J jnl
ShopTalk: A System for Conversational Faceted Search.
CoRR
Gurmeet Manku, James Lee-Thorp, Bhargav Kanagal, Joshua Ainslie, Jingchen Feng, Zach Pearson, Ebenezer Anjorin, Sudeep Gandhe, Ilya Eckstein, Jim Rosswog, Sumit Sanghai, Michael Pohl, Larry Adams, D. Sivakumar
2020 J jnl
ETC: Encoding Long and Structured Data in Transformers.
CoRR
Joshua Ainslie, Santiago Ontañón, Chris Alberti, Philip Pham, Anirudh Ravula, Sumit Sanghai
2020 — conf
ETC: Encoding Long and Structured Inputs in Transformers.
EMNLP (1)
Joshua Ainslie, Santiago Ontañón, Chris Alberti, Vaclav Cvicek, Zachary Fisher, Philip Pham, Anirudh Ravula, Sumit Sanghai, Qifan Wang, Li Yang
2020 A* conf
Learning to Extract Attribute Value from Product via Question Answering: A Multi-task Approach.
KDD
Qifan Wang, Li Yang, Bhargav Kanagal, Sumit Sanghai, D. Sivakumar, Bin Shu, Zac Yu, Jon Elsas