Gabriel Ilharco

52 papers A* 16B 1Journal 27Unranked 7

Year	Rank	Type	Title / Venue / Authors
2025	A*	`conf`	Language models scale reliably with over-training and on downstream tasks. ICLR Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, Suchin Gururangan, Mitchell Wortsman, Rulin Shao, Jean Mercat, Alex Fang, Jeffrey Li, Sedrick Keh, Rui Xin, Marianna Nezhurina, Igor Vasiljevic, Luca Soldaini, Jenia Jitsev, Alex Dimakis, Gabriel Ilharco, Pang Wei Koh, Shuran Song, Thomas Kollar, et al.
2024	—	`—`	Building the Next Generation of Multimodal Models Gabriel Ilharco
2024	A*	`conf`	DataComp-LM: In search of the next generation of training sets for language models. NeurIPS Jeffrey Li, Alex Fang, Georgios Smyrnis, Maor Ivgi, Matt Jordan, Samir Yitzhak Gadre, Hritik Bansal, Etash Kumar Guha, Sedrick Scott Keh, Kushal Arora, Saurabh Garg, Rui Xin, Niklas Muennighoff, Reinhard Heckel, Jean Mercat, Mayee F. Chen, Suchin Gururangan, Mitchell Wortsman, Alon Albalak, Yonatan Bitton, Marianna Nezhurina, Amro Abbas, Cheng-Yu Hsieh, Dhruba Ghosh, Josh Gardner, Maciej Kilian, Hanlin Zhang, Rulin Shao, Sarah M. Pratt, Sunny Sanyal, Gabriel Ilharco, Giannis Daras, Kalyani Marathe, Aaron Gokaslan, Jieyu Zhang, Khyathi Raghavi Chandu, Thao Nguyen, Igor Vasiljevic, Sham M. Kakade, Shuran Song, Sujay Sanghavi, Fartash Faghri, Sewoong Oh, Luke Zettlemoyer, Kyle Lo, Alaaeldin El-Nouby, Hadi Pouransari, Alexander Toshev, Stephanie Wang, Dirk Groeneveld, Luca Soldaini, Pang Wei Koh, Jenia Jitsev, Thomas Kollar, Alex Dimakis, Yair Carmon, Achal Dave, Ludwig Schmidt, Vaishaal Shankar
2024	J	`jnl`	DataComp-LM: In search of the next generation of training sets for language models. CoRR Jeffrey Li, Alex Fang, Georgios Smyrnis, Maor Ivgi, Matt Jordan, Samir Yitzhak Gadre, Hritik Bansal, Etash Kumar Guha, Sedrick Keh, Kushal Arora, Saurabh Garg, Rui Xin, Niklas Muennighoff, Reinhard Heckel, Jean Mercat, Mayee F. Chen, Suchin Gururangan, Mitchell Wortsman, Alon Albalak, Yonatan Bitton, Marianna Nezhurina, Amro Abbas, Cheng-Yu Hsieh, Dhruba Ghosh, Josh Gardner, Maciej Kilian, Hanlin Zhang, Rulin Shao, Sarah M. Pratt, Sunny Sanyal, Gabriel Ilharco, Giannis Daras, Kalyani Marathe, Aaron Gokaslan, Jieyu Zhang, Khyathi Raghavi Chandu, Thao Nguyen, Igor Vasiljevic, Sham M. Kakade, Shuran Song, Sujay Sanghavi, Fartash Faghri, Sewoong Oh, Luke Zettlemoyer, Kyle Lo, Alaaeldin El-Nouby, Hadi Pouransari, Alexander Toshev, Stephanie Wang, Dirk Groeneveld, Luca Soldaini, Pang Wei Koh, Jenia Jitsev, Thomas Kollar, Alexandros G. Dimakis, Yair Carmon, Achal Dave, Ludwig Schmidt, Vaishaal Shankar
2024	J	`jnl`	Language models scale reliably with over-training and on downstream tasks. CoRR Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, Suchin Gururangan, Mitchell Wortsman, Rulin Shao, Jean Mercat, Alex Fang, Jeffrey Li, Sedrick Keh, Rui Xin, Marianna Nezhurina, Igor Vasiljevic, Jenia Jitsev, Alexandros G. Dimakis, Gabriel Ilharco, Shuran Song, Thomas Kollar, Yair Carmon, Achal Dave, Reinhard Heckel, Niklas Muennighoff, Ludwig Schmidt
2024	J	`jnl`	The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources. CoRR Shayne Longpre, Stella Biderman, Alon Albalak, Hailey Schoelkopf, Daniel McDuff, Sayash Kapoor, Kevin Klyman, Kyle Lo, Gabriel Ilharco, Nay San, Maribeth Rauh, Aviya Skowron, Bertie Vidgen, Laura Weidinger, Arvind Narayanan, Victor Sanh, David Ifeoluwa Adelani, Percy Liang, Rishi Bommasani, Peter Henderson, Sasha Luccioni, Yacine Jernite, Luca Soldaini
2024	J	`jnl`	The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources. Trans. Mach. Learn. Res. Shayne Longpre, Stella Biderman, Alon Albalak, Hailey Schoelkopf, Daniel McDuff, Sayash Kapoor, Kevin Klyman, Kyle Lo, Gabriel Ilharco, Nay San, Maribeth Rauh, Aviya Skowron, Bertie Vidgen, Laura Weidinger, Arvind Narayanan, Victor Sanh, David Ifeoluwa Adelani, Percy Liang, Rishi Bommasani, Peter Henderson, Sasha Luccioni, Yacine Jernite, Luca Soldaini
2023	A*	`conf`	Adaptive Testing of Computer Vision Models. ICCV Irena Gao, Gabriel Ilharco, Scott M. Lundberg, Marco Túlio Ribeiro
2023	A*	`conf`	CoWs on Pasture: Baselines and Benchmarks for Language-Driven Zero-Shot Object Navigation. CVPR Samir Yitzhak Gadre, Mitchell Wortsman, Gabriel Ilharco, Ludwig Schmidt, Shuran Song
2023	A*	`conf`	DataComp: In search of the next generation of multimodal datasets. NeurIPS Samir Yitzhak Gadre, Gabriel Ilharco, Alex Fang, Jonathan Hayase, Georgios Smyrnis, Thao Nguyen, Ryan Marten, Mitchell Wortsman, Dhruba Ghosh, Jieyu Zhang, Eyal Orgad, Rahim Entezari, Giannis Daras, Sarah M. Pratt, Vivek Ramanujan, Yonatan Bitton, Kalyani Marathe, Stephen Mussmann, Richard Vencu, Mehdi Cherti, Ranjay Krishna, Pang Wei Koh, Olga Saukh, Alexander J. Ratner, Shuran Song, Hannaneh Hajishirzi, Ali Farhadi, Romain Beaumont, Sewoong Oh, Alex Dimakis, Jenia Jitsev, Yair Carmon, Vaishaal Shankar, Ludwig Schmidt
2023	J	`jnl`	DataComp: In search of the next generation of multimodal datasets. CoRR Samir Yitzhak Gadre, Gabriel Ilharco, Alex Fang, Jonathan Hayase, Georgios Smyrnis, Thao Nguyen, Ryan Marten, Mitchell Wortsman, Dhruba Ghosh, Jieyu Zhang, Eyal Orgad, Rahim Entezari, Giannis Daras, Sarah M. Pratt, Vivek Ramanujan, Yonatan Bitton, Kalyani Marathe, Stephen Mussmann, Richard Vencu, Mehdi Cherti, Ranjay Krishna, Pang Wei Koh, Olga Saukh, Alexander Ratner, Shuran Song, Hannaneh Hajishirzi, Ali Farhadi, Romain Beaumont, Sewoong Oh, Alex Dimakis, Jenia Jitsev, Yair Carmon, Vaishaal Shankar, Ludwig Schmidt
2023	A*	`conf`	Editing models with task arithmetic. ICLR Gabriel Ilharco, Marco Túlio Ribeiro, Mitchell Wortsman, Ludwig Schmidt, Hannaneh Hajishirzi, Ali Farhadi
2023	J	`jnl`	Improving Multimodal Datasets with Image Captioning. CoRR Thao Nguyen, Samir Yitzhak Gadre, Gabriel Ilharco, Sewoong Oh, Ludwig Schmidt
2023	A*	`conf`	Improving multimodal datasets with image captioning. NeurIPS Thao Nguyen, Samir Yitzhak Gadre, Gabriel Ilharco, Sewoong Oh, Ludwig Schmidt
2023	J	`jnl`	OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models. CoRR Anas Awadalla, Irena Gao, Josh Gardner, Jack Hessel, Yusuf Hanafy, Wanrong Zhu, Kalyani Marathe, Yonatan Bitton, Samir Yitzhak Gadre, Shiori Sagawa, Jenia Jitsev, Simon Kornblith, Pang Wei Koh, Gabriel Ilharco, Mitchell Wortsman, Ludwig Schmidt
2023	A*	`conf`	Reproducible Scaling Laws for Contrastive Language-Image Learning. CVPR Mehdi Cherti, Romain Beaumont, Ross Wightman, Mitchell Wortsman, Gabriel Ilharco, Cade Gordon, Christoph Schuhmann, Ludwig Schmidt, Jenia Jitsev
2023	A*	`conf`	TaskWeb: Selecting Better Source Tasks for Multi-task NLP. EMNLP Joongwon Kim, Akari Asai, Gabriel Ilharco, Hannaneh Hajishirzi
2023	J	`jnl`	TaskWeb: Selecting Better Source Tasks for Multi-task NLP. CoRR Joongwon Kim, Akari Asai, Gabriel Ilharco, Hannaneh Hajishirzi
2022	J	`jnl`	Adaptive Testing of Computer Vision Models. CoRR Irena Gao, Gabriel Ilharco, Scott M. Lundberg, Marco Túlio Ribeiro
2022	J	`jnl`	CLIP on Wheels: Zero-Shot Object Navigation as Object Localization and Exploration. CoRR Samir Yitzhak Gadre, Mitchell Wortsman, Gabriel Ilharco, Ludwig Schmidt, Shuran Song
2022	A*	`conf`	Data Determines Distributional Robustness in Contrastive Language Image Pre-training (CLIP). ICML Alex Fang, Gabriel Ilharco, Mitchell Wortsman, Yuhao Wan, Vaishaal Shankar, Achal Dave, Ludwig Schmidt
2022	J	`jnl`	Data Determines Distributional Robustness in Contrastive Language Image Pre-training (CLIP). CoRR Alex Fang, Gabriel Ilharco, Mitchell Wortsman, Yuhao Wan, Vaishaal Shankar, Achal Dave, Ludwig Schmidt
2022	J	`jnl`	Editing Models with Task Arithmetic. CoRR Gabriel Ilharco, Marco Túlio Ribeiro, Mitchell Wortsman, Suchin Gururangan, Ludwig Schmidt, Hannaneh Hajishirzi, Ali Farhadi
2022	—	`conf`	Exploring The Landscape of Distributional Robustness for Question Answering Models. EMNLP (Findings) Anas Awadalla, Mitchell Wortsman, Gabriel Ilharco, Sewon Min, Ian Magnusson, Hannaneh Hajishirzi, Ludwig Schmidt
2022	J	`jnl`	Exploring The Landscape of Distributional Robustness for Question Answering Models. CoRR Anas Awadalla, Mitchell Wortsman, Gabriel Ilharco, Sewon Min, Ian Magnusson, Hannaneh Hajishirzi, Ludwig Schmidt
2022	A*	`conf`	Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time. ICML Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs, Raphael Gontijo Lopes, Ari S. Morcos, Hongseok Namkoong, Ali Farhadi, Yair Carmon, Simon Kornblith, Ludwig Schmidt
2022	J	`jnl`	Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time. CoRR Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs, Raphael Gontijo Lopes, Ari S. Morcos, Hongseok Namkoong, Ali Farhadi, Yair Carmon, Simon Kornblith, Ludwig Schmidt
2022	A*	`conf`	Patching open-vocabulary models by interpolating weights. NeurIPS Gabriel Ilharco, Mitchell Wortsman, Samir Yitzhak Gadre, Shuran Song, Hannaneh Hajishirzi, Simon Kornblith, Ali Farhadi, Ludwig Schmidt
2022	J	`jnl`	Patching open-vocabulary models by interpolating weights. CoRR Gabriel Ilharco, Mitchell Wortsman, Samir Yitzhak Gadre, Shuran Song, Hannaneh Hajishirzi, Simon Kornblith, Ali Farhadi, Ludwig Schmidt
2022	A*	`conf`	Quality Not Quantity: On the Interaction between Dataset Design and Robustness of CLIP. NeurIPS Thao Nguyen, Gabriel Ilharco, Mitchell Wortsman, Sewoong Oh, Ludwig Schmidt
2022	J	`jnl`	Quality Not Quantity: On the Interaction between Dataset Design and Robustness of CLIP. CoRR Thao Nguyen, Gabriel Ilharco, Mitchell Wortsman, Sewoong Oh, Ludwig Schmidt
2022	J	`jnl`	Reproducible scaling laws for contrastive language-image learning. CoRR Mehdi Cherti, Romain Beaumont, Ross Wightman, Mitchell Wortsman, Gabriel Ilharco, Cade Gordon, Christoph Schuhmann, Ludwig Schmidt, Jenia Jitsev
2022	A*	`conf`	Robust fine-tuning of zero-shot models. CVPR Mitchell Wortsman, Gabriel Ilharco, Jong Wook Kim, Mike Li, Simon Kornblith, Rebecca Roelofs, Raphael Gontijo Lopes, Hannaneh Hajishirzi, Ali Farhadi, Hongseok Namkoong, Ludwig Schmidt
2021	J	`jnl`	Contrasting Contrastive Self-Supervised Representation Learning Models. CoRR Klemen Kotar, Gabriel Ilharco, Ludwig Schmidt, Kiana Ehsani, Roozbeh Mottaghi
2021	A*	`conf`	Contrasting Contrastive Self-Supervised Representation Learning Pipelines. ICCV Klemen Kotar, Gabriel Ilharco, Ludwig Schmidt, Kiana Ehsani, Roozbeh Mottaghi
2021	—	`conf`	Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus. EMNLP (1) Jesse Dodge, Maarten Sap, Ana Marasovic, William Agnew, Gabriel Ilharco, Dirk Groeneveld, Margaret Mitchell, Matt Gardner
2021	J	`jnl`	Documenting the English Colossal Clean Crawled Corpus. CoRR Jesse Dodge, Maarten Sap, Ana Marasovic, William Agnew, Gabriel Ilharco, Dirk Groeneveld, Matt Gardner
2021	—	`conf`	Finetuning Pretrained Transformers into RNNs. EMNLP (1) Jungo Kasai, Hao Peng, Yizhe Zhang, Dani Yogatama, Gabriel Ilharco, Nikolaos Pappas, Yi Mao, Weizhu Chen, Noah A. Smith
2021	J	`jnl`	Finetuning Pretrained Transformers into RNNs. CoRR Jungo Kasai, Hao Peng, Yizhe Zhang, Dani Yogatama, Gabriel Ilharco, Nikolaos Pappas, Yi Mao, Weizhu Chen, Noah A. Smith
2021	J	`jnl`	MultiModalQA: Complex Question Answering over Text, Tables and Images. CoRR Alon Talmor, Ori Yoran, Amnon Catav, Dan Lahav, Yizhong Wang, Akari Asai, Gabriel Ilharco, Hannaneh Hajishirzi, Jonathan Berant
2021	A*	`conf`	MultiModalQA: complex question answering over text, tables and images. ICLR Alon Talmor, Ori Yoran, Amnon Catav, Dan Lahav, Yizhong Wang, Akari Asai, Gabriel Ilharco, Hannaneh Hajishirzi, Jonathan Berant
2021	—	`conf`	Probing Contextual Language Models for Common Ground with Visual Representations. NAACL-HLT Gabriel Ilharco, Rowan Zellers, Ali Farhadi, Hannaneh Hajishirzi
2021	J	`jnl`	Robust fine-tuning of zero-shot models. CoRR Mitchell Wortsman, Gabriel Ilharco, Mike Li, Jong Wook Kim, Hannaneh Hajishirzi, Ali Farhadi, Hongseok Namkoong, Ludwig Schmidt
2020	—	`conf`	Evaluating Models' Local Decision Boundaries via Contrast Sets. EMNLP (Findings) Matt Gardner, Yoav Artzi, Victoria Basmova, Jonathan Berant, Ben Bogin, Sihao Chen, Pradeep Dasigi, Dheeru Dua, Yanai Elazar, Ananth Gottumukkala, Nitish Gupta, Hannaneh Hajishirzi, Gabriel Ilharco, Daniel Khashabi, Kevin Lin, Jiangming Liu, Nelson F. Liu, Phoebe Mulcaire, Qiang Ning, Sameer Singh, Noah A. Smith, Sanjay Subramanian, Reut Tsarfaty, Eric Wallace, Ally Zhang, Ben Zhou
2020	J	`jnl`	Evaluating NLP Models via Contrast Sets. CoRR Matt Gardner, Yoav Artzi, Victoria Basmova, Jonathan Berant, Ben Bogin, Sihao Chen, Pradeep Dasigi, Dheeru Dua, Yanai Elazar, Ananth Gottumukkala, Nitish Gupta, Hanna Hajishirzi, Gabriel Ilharco, Daniel Khashabi, Kevin Lin, Jiangming Liu, Nelson F. Liu, Phoebe Mulcaire, Qiang Ning, Sameer Singh, Noah A. Smith, Sanjay Subramanian, Reut Tsarfaty, Eric Wallace, Ally Zhang, Ben Zhou
2020	J	`jnl`	Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping. CoRR Jesse Dodge, Gabriel Ilharco, Roy Schwartz, Ali Farhadi, Hannaneh Hajishirzi, Noah A. Smith
2020	—	`conf`	High Performance Natural Language Processing. EMNLP (Tutorial Abstracts) Gabriel Ilharco, Cesar Ilharco, Iulia Turc, Tim Dettmers, Felipe Ferreira, Kenton Lee
2020	J	`jnl`	Probing Text Models for Common Ground with Visual Representations. CoRR Gabriel Ilharco, Rowan Zellers, Ali Farhadi, Hannaneh Hajishirzi
2019	J	`jnl`	General Evaluation for Instruction Conditioned Navigation using Dynamic Time Warping CoRR Gabriel Ilharco, Vihan Jain, Alexander Ku, Eugene Ie, Jason Baldridge
2019	—	`conf`	General Evaluation for Instruction Conditioned Navigation using Dynamic Time Warping. ViGIL@NeurIPS Gabriel Ilharco, Vihan Jain, Alexander Ku, Eugene Ie, Jason Baldridge
2019	B	`conf`	Large-Scale Representation Learning from Visually Grounded Untranscribed Speech. CoNLL Gabriel Ilharco, Yuan Zhang, Jason Baldridge
2019	J	`jnl`	Large-scale representation learning from visually grounded untranscribed speech. CoRR Gabriel Ilharco, Yuan Zhang, Jason Baldridge