Mostafa Elhoushi

49 papers A* 9A 1B 1Misc 1Journal 30Unranked 7

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Calibrating Beyond English: Language Diversity for Better Quantized Multilingual LLM. CoRR Everlyn Asiko Chimoto, Mostafa Elhoushi, Bruce A. Bassett
2026	—	`conf`	Calibrating Beyond English: Language Diversity for Better Quantized Multilingual LLMs. EACL (Volume 1: Long Papers) Everlyn Asiko Chimoto, Mostafa Elhoushi, Bruce A. Bassett
2025	J	`jnl`	Carbon Aware Transformers Through Joint Model-Hardware Optimization. CoRR Irene Wang, Newsha Ardalani, Mostafa Elhoushi, Daniel Jiang, Samuel Hsia, Ekin Sumbul, Divya Mahajan, Carole-Jean Wu, Bilge Acun
2025	J	`jnl`	Characterizing and Efficiently Accelerating Multimodal Generation Model Inference. IEEE Micro Yejin Lee, Alicia Golden, Anna Y. Sun, Basil Hosmer, Bilge Acun, Can Balioglu, Changhan Wang, Charles David Hernandez, Christian Puhrsch, Daniel Haziza, Driss Guessous, Francisco Massa, Jacob Kahn, Jeffrey Wan, Jeremy Reizenstein, Jiaqi Zhai, Joe Isaacson, Joel Schlosser, Juan Pino, Kaushik Ram Sadagopan, Leonid Shamis, Linjian Ma, Min-Jae Hwang, Mingda Chen, Mostafa Elhoushi, Pedro Rodríguez, Ram Pasunuru, Samuel Hsia, Scott Yih, Sravya Popuri, Xing Liu, Carole-Jean Wu
2025	A*	`conf`	Demystifying Synthetic Data in LLM Pre-training: A Systematic Study of Scaling Laws, Benefits, and Pitfalls. EMNLP Feiyang Kang, Newsha Ardalani, Michael Kuchnik, Youssef Emad, Mostafa Elhoushi, Shubhabrata Sengupta, Shang-wen Li, Ramya Raghavendra, Ruoxi Jia, Carole-Jean Wu
2025	J	`jnl`	Demystifying Synthetic Data in LLM Pre-training: A Systematic Study of Scaling Laws, Benefits, and Pitfalls. CoRR Feiyang Kang, Newsha Ardalani, Michael Kuchnik, Youssef Emad, Mostafa Elhoushi, Shubhabrata Sengupta, Shang-wen Li, Ramya Raghavendra, Ruoxi Jia, Carole-Jean Wu
2025	J	`jnl`	Efficient Hardware Scaling and Diminishing Returns in Large-Scale Training of Language Models. Trans. Mach. Learn. Res. Jared Fernandez, Luca Wehrstedt, Leonid Shamis, Mostafa Elhoushi, Kalyan Saladi, Yonatan Bisk, Emma Strubell, Jacob Kahn
2025	J	`jnl`	Guiding Giants: Lightweight Controllers for Weighted Activation Steering in LLMs. CoRR Amr Hegazy, Mostafa Elhoushi, Amr Al-Anwar
2025	—	`conf`	PETAH: Parameter Efficient Task Adaptation for Hybrid Transformers. CVPR Workshops Maximilian Augustin, Syed Shakib Sarwar, Mostafa Elhoushi, Yuecheng Li, Sai Qian Zhang, Barbara De Salvo
2025	J	`jnl`	Structure-Aware Fill-in-the-Middle Pretraining for Code. CoRR Linyuan Gong, Alvin Cheung, Mostafa Elhoushi, Sida Wang
2025	A*	`conf`	any4: Learned 4-bit Numeric Representation for LLMs. ICML Mostafa Elhoushi, Jeff Johnson
2025	J	`jnl`	any4: Learned 4-bit Numeric Representation for LLMs. CoRR Mostafa Elhoushi, Jeff Johnson
2024	A*	`conf`	AST-T5: Structure-Aware Pretraining for Code Generation and Understanding. ICML Linyuan Gong, Mostafa Elhoushi, Alvin Cheung
2024	J	`jnl`	AST-T5: Structure-Aware Pretraining for Code Generation and Understanding. CoRR Linyuan Gong, Mostafa Elhoushi, Alvin Cheung
2024	J	`jnl`	Brevity is the soul of wit: Pruning long files for code generation. CoRR Aaditya K. Singh, Yu Yang, Kushal Tirumala, Mostafa Elhoushi, Ari S. Morcos
2024	A*	`conf`	CHAI: Clustered Head Attention for Efficient LLM Inference. ICML Saurabh Agarwal, Bilge Acun, Basil Hosmer, Mostafa Elhoushi, Yejin Lee, Shivaram Venkataraman, Dimitris Papailiopoulos, Carole-Jean Wu
2024	J	`jnl`	CHAI: Clustered Head Attention for Efficient LLM Inference. CoRR Saurabh Agarwal, Bilge Acun, Basil Hosmer, Mostafa Elhoushi, Yejin Lee, Shivaram Venkataraman, Dimitris Papailiopoulos, Carole-Jean Wu
2024	J	`jnl`	Characterizing and Efficiently Accelerating Multimodal Generation Model Inference. CoRR Yejin Lee, Anna Y. Sun, Basil Hosmer, Bilge Acun, Can Balioglu, Changhan Wang, Charles David Hernandez, Christian Puhrsch, Daniel Haziza, Driss Guessous, Francisco Massa, Jacob Kahn, Jeffrey Wan, Jeremy Reizenstein, Jiaqi Zhai, Joe Isaacson, Joel Schlosser, Juan Pino, Kaushik Ram Sadagopan, Leonid Shamis, Linjian Ma, Min-Jae Hwang, Mingda Chen, Mostafa Elhoushi, Pedro Rodriguez, Ram Pasunuru, Scott Yih, Sravya Popuri, Xing Liu, Carole-Jean Wu
2024	A*	`conf`	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks. ICML Linyuan Gong, Sida Wang, Mostafa Elhoushi, Alvin Cheung
2024	J	`jnl`	Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks. CoRR Linyuan Gong, Sida Wang, Mostafa Elhoushi, Alvin Cheung
2024	J	`jnl`	Hardware Scaling Trends and Diminishing Returns in Large-Scale Distributed Training. CoRR Jared Fernandez, Luca Wehrstedt, Leonid Shamis, Mostafa Elhoushi, Kalyan Saladi, Yonatan Bisk, Emma Strubell, Jacob Kahn
2024	—	`conf`	LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding. ACL (1) Mostafa Elhoushi, Akshat Shrivastava, Diana Liskovich, Basil Hosmer, Bram Wasti, Liangzhen Lai, Anas Mahmoud, Bilge Acun, Saurabh Agarwal, Ahmed Roman, Ahmed A. Aly, Beidi Chen, Carole-Jean Wu
2024	J	`jnl`	LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding. CoRR Mostafa Elhoushi, Akshat Shrivastava, Diana Liskovich, Basil Hosmer, Bram Wasti, Liangzhen Lai, Anas Mahmoud, Bilge Acun, Saurabh Agarwal, Ahmed Roman, Ahmed A. Aly, Beidi Chen, Carole-Jean Wu
2024	A	`conf`	Minuet: Accelerating 3D Sparse Convolutions on GPUs. EuroSys Jiacheng Yang, Christina Giannoula, Jun Wu, Mostafa Elhoushi, James Gleeson, Gennady Pekhimenko
2024	J	`jnl`	Minuet: Accelerating 3D Sparse Convolutions on GPUs. CoRR Jiacheng Yang, Christina Giannoula, Jun Wu, Mostafa Elhoushi, James Gleeson, Gennady Pekhimenko
2024	J	`jnl`	PETAH: Parameter Efficient Task Adaptation for Hybrid Transformers in a resource-limited Context. CoRR Maximilian Augustin, Syed Shakib Sarwar, Mostafa Elhoushi, Sai Qian Zhang, Yuecheng Li, Barbara De Salvo
2024	A*	`conf`	Sieve: Multimodal Dataset Pruning Using Image Captioning Models. CVPR Anas Mahmoud, Mostafa Elhoushi, Amro Abbas, Yu Yang, Newsha Ardalani, Hugh Leather, Ari S. Morcos
2023	J	`jnl`	Decoding Data Quality via Synthetic Corruptions: Embedding-guided Pruning of Code Data. CoRR Yu Yang, Aaditya K. Singh, Mostafa Elhoushi, Anas Mahmoud, Kushal Tirumala, Fabian Gloeckle, Baptiste Rozière, Carole-Jean Wu, Ari S. Morcos, Newsha Ardalani
2023	J	`jnl`	Large Language Models for Compiler Optimization. CoRR Chris Cummins, Volker Seeker, Dejan Grubisic, Mostafa Elhoushi, Youwei Liang, Baptiste Rozière, Jonas Gehring, Fabian Gloeckle, Kim M. Hazelwood, Gabriel Synnaeve, Hugh Leather
2023	A*	`conf`	Learning Compiler Pass Orders using Coreset and Normalized Value Prediction. ICML Youwei Liang, Kevin Stone, Ali Shameli, Chris Cummins, Mostafa Elhoushi, Jiadong Guo, Benoit Steiner, Xiaomeng Yang, Pengtao Xie, Hugh James Leather, Yuandong Tian
2023	J	`jnl`	Learning Compiler Pass Orders using Coreset and Normalized Value Prediction. CoRR Youwei Liang, Kevin Stone, Ali Shameli, Chris Cummins, Mostafa Elhoushi, Jiadong Guo, Benoit Steiner, Xiaomeng Yang, Pengtao Xie, Hugh Leather, Yuandong Tian
2023	A*	`conf`	MODeL: Memory Optimizations for Deep Learning. ICML Benoit Steiner, Mostafa Elhoushi, Jacob Kahn, James Hegarty
2023	J	`jnl`	SIEVE: Multimodal Dataset Pruning Using Image Captioning Models. CoRR Anas Mahmoud, Mostafa Elhoushi, Amro Abbas, Yu Yang, Newsha Ardalani, Hugh Leather, Ari Morcos
2022	A*	`conf`	Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction. CVPR Sara Elkerdawy, Mostafa Elhoushi, Hong Zhang, Nilanjan Ray
2022	J	`jnl`	MLGOPerf: An ML Guided Inliner to Optimize Performance. CoRR Amir H. Ashouri, Mostafa Elhoushi, Yuzhe Hua, Xiang Wang, Muhammad Asif Manzoor, Bryan Chan, Yaoqing Gao
2022	J	`jnl`	OLLA: Decreasing the Memory Usage of Neural Networks by Optimizing the Lifetime and Location of Arrays. CoRR Benoit Steiner, Mostafa Elhoushi, Jacob Kahn, James Hegarty
2022	Misc	`conf`	Work-in-Progress: MLGOPerf: An ML Guided Inliner to Optimize Performance. CASES Amir H. Ashouri, Mostafa Elhoushi, Yuzhe Hua, Xiang Wang, Muhammad Asif Manzoor, Bryan Chan, Yaoqing Gao
2021	—	`conf`	DeepShift: Towards Multiplication-Less Neural Networks. CVPR Workshops Mostafa Elhoushi, Zihao Chen, Farhan Shafiq, Ye Henry Tian, Joey Yiwei Li
2021	J	`jnl`	Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction. CoRR Sara Elkerdawy, Mostafa Elhoushi, Hong Zhang, Nilanjan Ray
2021	—	`conf`	Layer Importance Estimation With Imprinting for Neural Network Quantization. CVPR Workshops Hongyang Liu, Sara Elkerdawy, Nilanjan Ray, Mostafa Elhoushi
2020	B	`conf`	One-Shot Layer-Wise Accuracy Approximation For Layer Pruning. ICIP Sara Elkerdawy, Mostafa Elhoushi, Abhineet Singh, Hong Zhang, Nilanjan Ray
2020	—	`conf`	To Filter Prune, or to Layer Prune, That Is the Question. ACCV (3) Sara Elkerdawy, Mostafa Elhoushi, Abhineet Singh, Hong Zhang, Nilanjan Ray
2020	J	`jnl`	To filter prune, or to layer prune, that is the question. CoRR Sara Elkerdawy, Mostafa Elhoushi, Abhineet Singh, Hong Zhang, Nilanjan Ray
2019	J	`jnl`	Accelerating Training using Tensor Decomposition. CoRR Mostafa Elhoushi, Ye Henry Tian, Zihao Chen, Farhan Shafiq, Joey Yiwei Li
2019	J	`jnl`	DeepShift: Towards Multiplication-Less Neural Networks. CoRR Mostafa Elhoushi, Farhan Shafiq, Ye Henry Tian, Joey Yiwei Li, Zihao Chen
2017	J	`jnl`	A Survey on Approaches of Motion Mode Recognition Using Sensors. IEEE Trans. Intell. Transp. Syst. Mostafa Elhoushi, Jacques Georgy, Aboelmagd Noureldin, Michael J. Korenberg
2016	J	`jnl`	Motion Mode Recognition for Indoor Pedestrian Navigation Using Portable Devices. IEEE Trans. Instrum. Meas. Mostafa Elhoushi, Jacques Georgy, Aboelmagd Noureldin, Michael J. Korenberg
2014	J	`jnl`	Model of a hybrid processor executing C++ with additional quantum functions. Microprocess. Microsystems Mostafa Elhoushi, M. Watheq El-Kharashi, Hatem Elrefaei
2014	—	`conf`	Using portable device sensors to recognize height changing modes of motion. I2MTC Mostafa Elhoushi, Jacques Georgy, Ahmed Wahdan, Michael J. Korenberg, Aboelmagd Noureldin