Akshat Shrivastava

47 papers A* 2A 4Misc 1Journal 27Unranked 13

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Improving MoE Compute Efficiency by Composing Weight and Data Sparsity. CoRR Maciej Kilian, Oleg Mkrtchyan, Luke Zettlemoyer, Akshat Shrivastava, Armen Aghajanyan
2026	J	`jnl`	SkillRater: Untangling Capabilities in Multimodal Data. CoRR Naveen Sahi, Jeremy Dohmann, Armen Aghajanyan, Akshat Shrivastava
2025	J	`jnl`	CoSMoEs: Compact Sparse Mixture of Experts. CoRR Patrick Huber, Akshat Shrivastava, Ernie Chang, Chinnadhurai Sankar, Ahmed Aly, Adithya Sagar
2024	J	`jnl`	CoDi: Conversational Distillation for Grounded Question Answering. CoRR Patrick Huber, Arash Einolghozati, Rylan Conway, Kanika Narang, Matt Smith, Waqar Nayyar, Adithya Sagar, Ahmed Aly, Akshat Shrivastava
2024	—	`conf`	Governance Practices for Open Source Foundations in the Healthcare Sector. ICSOB Elçin Yenisen Yavuz, Akshat Shrivastava, Dirk Riehle, Florian Putz
2024	—	`conf`	LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding. ACL (1) Mostafa Elhoushi, Akshat Shrivastava, Diana Liskovich, Basil Hosmer, Bram Wasti, Liangzhen Lai, Anas Mahmoud, Bilge Acun, Saurabh Agarwal, Ahmed Roman, Ahmed A. Aly, Beidi Chen, Carole-Jean Wu
2024	J	`jnl`	LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding. CoRR Mostafa Elhoushi, Akshat Shrivastava, Diana Liskovich, Basil Hosmer, Bram Wasti, Liangzhen Lai, Anas Mahmoud, Bilge Acun, Saurabh Agarwal, Ahmed Roman, Ahmed A. Aly, Beidi Chen, Carole-Jean Wu
2024	J	`jnl`	MoMa: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts. CoRR Xi Victoria Lin, Akshat Shrivastava, Liang Luo, Srinivasan Iyer, Mike Lewis, Gargi Ghosh, Luke Zettlemoyer, Armen Aghajanyan
2024	—	`conf`	PRoDeliberation: Parallel Robust Deliberation for End-to-End Spoken Language Understanding. EMNLP (Findings) Trang Le, Daniel Lazar, Suyoun Kim, Shan Jiang, Duc Le, Adithya Sagar, Aleksandr Livshits, Ahmed Aly, Akshat Shrivastava
2024	J	`jnl`	PRoDeliberation: Parallel Robust Deliberation for End-to-End Spoken Language Understanding. CoRR Trang Le, Daniel Lazar, Suyoun Kim, Shan Jiang, Duc Le, Adithya Sagar, Aleksandr Livshits, Ahmed Aly, Akshat Shrivastava
2024	A*	`conf`	PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs. ICML Charlie Hou, Akshat Shrivastava, Hongyuan Zhan, Rylan Conway, Trang Le, Adithya Sagar, Giulia Fanti, Daniel Lazar
2024	J	`jnl`	PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs. CoRR Charlie Hou, Akshat Shrivastava, Hongyuan Zhan, Rylan Conway, Trang Le, Adithya Sagar, Giulia Fanti, Daniel Lazar
2024	—	`conf`	Small But Funny: A Feedback-Driven Approach to Humor Distillation. ACL (1) Sahithya Ravi, Patrick Huber, Akshat Shrivastava, Vered Shwartz, Arash Einolghozati
2024	J	`jnl`	Small But Funny: A Feedback-Driven Approach to Humor Distillation. CoRR Sahithya Ravi, Patrick Huber, Akshat Shrivastava, Adithya Sagar, Ahmed Aly, Vered Shwartz, Arash Einolghozati
2023	—	`conf`	An Intelligent and Deep Learning Approach for Pothole Surveillance Smart Application. ICMLDE Sushila Palwe, Anita Gunjal, Sanskar Jindal, Akshat Shrivastava, Atharva Deshmukh, Mehul Navalakha
2023	J	`jnl`	Augmenting text for spoken language understanding with Large Language Models. CoRR Roshan Sharma, Suyoun Kim, Daniel Lazar, Trang Le, Akshat Shrivastava, Kwanghoon Ahn, Piyush Kansal, Leda Sari, Ozlem Kalinli, Michael L. Seltzer
2023	Misc	`conf`	ICASSP 2023 Spoken Language Understanding Grand Challenge. ICASSP Akshat Shrivastava, Suyoun Kim, Paden Tomasello, Ali Elkahky, Daniel Lazar, Trang Le, Shan Jiang, Duc Le, Aleksandr Livshits, Ahmed Aly
2023	—	`conf`	Introducing Semantics into Speech Encoders. ACL (1) Derek Xu, Shuyan Dong, Changhan Wang, Suyoun Kim, Zhaojiang Lin, Bing Liu, Akshat Shrivastava, Shang-wen Li, Liang-Hsuan Tseng, Guan-Ting Lin, Alexei Baevski, Hung-yi Lee, Yizhou Sun, Wei Wang
2023	A	`conf`	Modality Confidence Aware Training for Robust End-to-End Spoken Language Understanding. INTERSPEECH Suyoun Kim, Akshat Shrivastava, Duc Le, Ju Lin, Ozlem Kalinli, Michael L. Seltzer
2023	J	`jnl`	Modality Confidence Aware Training for Robust End-to-End Spoken Language Understanding. CoRR Suyoun Kim, Akshat Shrivastava, Duc Le, Ju Lin, Ozlem Kalinli, Michael L. Seltzer
2023	J	`jnl`	Privately Customizing Prefinetuning to Better Match User Data in Federated Learning. CoRR Charlie Hou, Hongyuan Zhan, Akshat Shrivastava, Sid Wang, Aleksandr Livshits, Giulia Fanti, Daniel Lazar
2023	A	`conf`	Retrieve-and-Fill for Scenario-based Task-Oriented Semantic Parsing. EACL Akshat Shrivastava, Shrey Desai, Anchit Gupta, Ali Elkahky, Aleksandr Livshits, Alexander Zotov, Ahmed Aly
2023	J	`jnl`	TreePiece: Faster Semantic Parsing via Tree Tokenization. CoRR Sid Wang, Akshat Shrivastava, Sasha Livshits
2023	—	`conf`	Treepiece: Faster Semantic Parsing via Tree Tokenization. EMNLP (Findings) Sid Wang, Akshat Shrivastava, Aleksandr Livshits
2022	J	`jnl`	Data-Efficiency with a Single GPU: An Exploration of Transfer Methods for Small Language Models. CoRR Alon Albalak, Akshat Shrivastava, Chinnadhurai Sankar, Adithya Sagar, Mike Ross
2022	A	`conf`	Deliberation Model for On-Device Spoken Language Understanding. INTERSPEECH Duc Le, Akshat Shrivastava, Paden D. Tomasello, Suyoun Kim, Aleksandr Livshits, Ozlem Kalinli, Michael L. Seltzer
2022	J	`jnl`	Deliberation Model for On-Device Spoken Language Understanding. CoRR Duc Le, Akshat Shrivastava, Paden Tomasello, Suyoun Kim, Aleksandr Livshits, Ozlem Kalinli, Michael L. Seltzer
2022	J	`jnl`	Introducing Semantics into Speech Encoders. CoRR Derek Xu, Shuyan Dong, Changhan Wang, Suyoun Kim, Zhaojiang Lin, Akshat Shrivastava, Shang-wen Li, Liang-Hsuan Tseng, Alexei Baevski, Guan-Ting Lin, Hung-yi Lee, Yizhou Sun, Wei Wang
2022	J	`jnl`	Retrieve-and-Fill for Scenario-based Task-Oriented Semantic Parsing. CoRR Akshat Shrivastava, Shrey Desai, Anchit Gupta, Ali Elkahky, Aleksandr Livshits, Alexander Zotov, Ahmed Aly
2022	—	`conf`	RetroNLU: Retrieval Augmented Task-Oriented Semantic Parsing. ConvAI@ACL Vivek Gupta, Akshat Shrivastava, Adithya Sagar, Armen Aghajanyan, Denis Savenkov
2022	J	`jnl`	STOP: A dataset for Spoken Task Oriented Semantic Parsing. CoRR Paden Tomasello, Akshat Shrivastava, Daniel Lazar, Po-Chun Hsu, Duc Le, Adithya Sagar, Ali Elkahky, Jade Copet, Wei-Ning Hsu, Yossef Mordechay, Robin Algayres, Tu Anh Nguyen, Emmanuel Dupoux, Luke Zettlemoyer, Abdelrahman Mohamed
2022	—	`conf`	Stop: A Dataset for Spoken Task Oriented Semantic Parsing. SLT Paden Tomasello, Akshat Shrivastava, Daniel Lazar, Po-Chun Hsu, Duc Le, Adithya Sagar, Ali Elkahky, Jade Copet, Wei-Ning Hsu, Yossi Adi, Robin Algayres, Tu Anh Nguyen, Emmanuel Dupoux, Luke Zettlemoyer, Abdelrahman Mohamed
2021	J	`jnl`	Assessing Data Efficiency in Task-Oriented Semantic Parsing. CoRR Shrey Desai, Akshat Shrivastava, Justin Rill, Brian Moran, Safiyyah Saleem, Alexander Zotov, Ahmed Aly
2021	A*	`conf`	Better Fine-Tuning by Reducing Representational Collapse. ICLR Armen Aghajanyan, Akshat Shrivastava, Anchit Gupta, Naman Goyal, Luke Zettlemoyer, Sonal Gupta
2021	J	`jnl`	Latency-Aware Neural Architecture Search with Multi-Objective Bayesian Optimization. CoRR David Eriksson, Pierce I-Jen Chuang, Samuel Daulton, Peng Xia, Akshat Shrivastava, Arun Babu, Shicong Zhao, Ahmed Aly, Ganesh Venkatesh, Maximilian Balandat
2021	J	`jnl`	Low-Resource Task-Oriented Semantic Parsing via Intrinsic Modeling. CoRR Shrey Desai, Akshat Shrivastava, Alexander Zotov, Ahmed Aly
2021	—	`conf`	Muppet: Massive Multi-task Representations with Pre-Finetuning. EMNLP (1) Armen Aghajanyan, Anchit Gupta, Akshat Shrivastava, Xilun Chen, Luke Zettlemoyer, Sonal Gupta
2021	J	`jnl`	Muppet: Massive Multi-task Representations with Pre-Finetuning. CoRR Armen Aghajanyan, Anchit Gupta, Akshat Shrivastava, Xilun Chen, Luke Zettlemoyer, Sonal Gupta
2021	—	`conf`	Non-Autoregressive Semantic Parsing for Compositional Task-Oriented Dialog. NAACL-HLT Arun Babu, Akshat Shrivastava, Armen Aghajanyan, Ahmed Aly, Angela Fan, Marjan Ghazvininejad
2021	J	`jnl`	Non-Autoregressive Semantic Parsing for Compositional Task-Oriented Dialog. CoRR Arun Babu, Akshat Shrivastava, Armen Aghajanyan, Ahmed Aly, Angela Fan, Marjan Ghazvininejad
2021	J	`jnl`	RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsing. CoRR Vivek Gupta, Akshat Shrivastava, Adithya Sagar, Armen Aghajanyan, Denis Savenkov
2021	—	`conf`	Span Pointer Networks for Non-Autoregressive Task-Oriented Semantic Parsing. EMNLP (Findings) Akshat Shrivastava, Pierce Chuang, Arun Babu, Shrey Desai, Abhinav Arora, Alexander Zotov, Ahmed Aly
2021	J	`jnl`	Span Pointer Networks for Non-Autoregressive Task-Oriented Semantic Parsing. CoRR Akshat Shrivastava, Pierce Chuang, Arun Babu, Shrey Desai, Abhinav Arora, Alexander Zotov, Ahmed Aly
2020	J	`jnl`	Better Fine-Tuning by Reducing Representational Collapse. CoRR Armen Aghajanyan, Akshat Shrivastava, Anchit Gupta, Naman Goyal, Luke Zettlemoyer, Sonal Gupta
2020	—	`conf`	Conversational Semantic Parsing. EMNLP (1) Armen Aghajanyan, Jean Maillard, Akshat Shrivastava, Keith Diedrick, Michael Haeger, Haoran Li, Yashar Mehdad, Veselin Stoyanov, Anuj Kumar, Mike Lewis, Sonal Gupta
2020	J	`jnl`	Conversational Semantic Parsing. CoRR Armen Aghajanyan, Jean Maillard, Akshat Shrivastava, Keith Diedrick, Mike Haeger, Haoran Li, Yashar Mehdad, Ves Stoyanov, Anuj Kumar, Mike Lewis, Sonal Gupta
2020	A	`conf`	iSeqL: interactive sequence learning. IUI Akshat Shrivastava, Jeffrey Heer