Denny Zhou - RankMe

113 papers A* 40A 1Journal 64Unranked 8

Year	Rank	Type	Title / Venue / Authors
2024	—	`conf`	A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity. NAACL-HLT Shayne Longpre, Gregory Yauney, Emily Reif, Katherine Lee, Adam Roberts, Barret Zoph, Denny Zhou, Jason Wei, Kevin Robinson, David Mimno, Daphne Ippolito
2024	J	`jnl`	Best Practices and Lessons Learned on Synthetic Data for Language Models. CoRR Ruibo Liu, Jerry Wei, Fangyu Liu, Chenglei Si, Yanzhe Zhang, Jinmeng Rao, Steven Zheng, Daiyi Peng, Diyi Yang, Denny Zhou, Andrew M. Dai
2024	J	`jnl`	CRISPR-GPT: An LLM Agent for Automated Design of Gene-Editing Experiments. CoRR Kaixuan Huang, Yuanhao Qu, Henry Cousins, William A. Johnson, Di Yin, Mihir Shah, Denny Zhou, Russ B. Altman, Mengdi Wang, Le Cong
2024	A*	`conf`	Chain of Thought Empowers Transformers to Solve Inherently Serial Problems. ICLR Zhiyuan Liu, Hong Liu, Denny Zhou, Tengyu Ma
2024	J	`jnl`	Chain of Thought Empowers Transformers to Solve Inherently Serial Problems. CoRR Zhiyuan Li, Hong Liu, Denny Zhou, Tengyu Ma
2024	A*	`conf`	Chain-of-Thought Reasoning Without Prompting. NeurIPS Xuezhi Wang, Denny Zhou
2024	J	`jnl`	Chain-of-Thought Reasoning Without Prompting. CoRR Xuezhi Wang, Denny Zhou
2024	J	`jnl`	Deep State-Space Generative Model For Correlated Time-to-Event Predictions. CoRR Yuan Xue, Denny Zhou, Nan Du, Andrew M. Dai, Zhen Xu, Kun Zhang, Claire Cui
2024	—	`conf`	FreshLLMs: Refreshing Large Language Models with Search Engine Augmentation. ACL (Findings) Tu Vu, Mohit Iyyer, Xuezhi Wang, Noah Constant, Jerry W. Wei, Jason Wei, Chris Tar, Yun-Hsuan Sung, Denny Zhou, Quoc V. Le, Thang Luong
2024	A*	`conf`	Large Language Models Cannot Self-Correct Reasoning Yet. ICLR Jie Huang, Xinyun Chen, Swaroop Mishra, Huaixiu Steven Zheng, Adams Wei Yu, Xinying Song, Denny Zhou
2024	A*	`conf`	Large Language Models as Analogical Reasoners. ICLR Michihiro Yasunaga, Xinyun Chen, Yujia Li, Panupong Pasupat, Jure Leskovec, Percy Liang, Ed H. Chi, Denny Zhou
2024	A*	`conf`	Large Language Models as Optimizers. ICLR Chengrun Yang, Xuezhi Wang, Yifeng Lu, Hanxiao Liu, Quoc V. Le, Denny Zhou, Xinyun Chen
2024	A*	`conf`	Large Language Models as Tool Makers. ICLR Tianle Cai, Xuezhi Wang, Tengyu Ma, Xinyun Chen, Denny Zhou
2024	A*	`conf`	Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models. ICLR Sheng Shen, Le Hou, Yanqi Zhou, Nan Du, Shayne Longpre, Jason Wei, Hyung Won Chung, Barret Zoph, William Fedus, Xinyun Chen, Tu Vu, Yuexin Wu, Wuyang Chen, Albert Webson, Yunxuan Li, Vincent Y. Zhao, Hongkun Yu, Kurt Keutzer, Trevor Darrell, Denny Zhou
2024	J	`jnl`	NATURAL PLAN: Benchmarking LLMs on Natural Language Planning. CoRR Huaixiu Steven Zheng, Swaroop Mishra, Hugh Zhang, Xinyun Chen, Minmin Chen, Azade Nova, Le Hou, Heng-Tze Cheng, Quoc V. Le, Ed H. Chi, Denny Zhou
2024	A*	`conf`	Premise Order Matters in Reasoning with Large Language Models. ICML Xinyun Chen, Ryan A. Chi, Xuezhi Wang, Denny Zhou
2024	J	`jnl`	Premise Order Matters in Reasoning with Large Language Models. CoRR Xinyun Chen, Ryan A. Chi, Xuezhi Wang, Denny Zhou
2024	A*	`conf`	SELF-DISCOVER: Large Language Models Self-Compose Reasoning Structures. NeurIPS Pei Zhou, Jay Pujara, Xiang Ren, Xinyun Chen, Heng-Tze Cheng, Quoc V. Le, Ed H. Chi, Denny Zhou, Swaroop Mishra, Huaixiu Steven Zheng
2024	J	`jnl`	Scaling Instruction-Finetuned Language Models. J. Mach. Learn. Res. Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Alex Castro-Ros, Marie Pellat, Kevin Robinson, Dasha Valter, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Y. Zhao, Yanping Huang, Andrew M. Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei
2024	J	`jnl`	Self-Discover: Large Language Models Self-Compose Reasoning Structures. CoRR Pei Zhou, Jay Pujara, Xiang Ren, Xinyun Chen, Heng-Tze Cheng, Quoc V. Le, Ed H. Chi, Denny Zhou, Swaroop Mishra, Huaixiu Steven Zheng
2024	A*	`conf`	Take a Step Back: Evoking Reasoning via Abstraction in Large Language Models. ICLR Huaixiu Steven Zheng, Swaroop Mishra, Xinyun Chen, Heng-Tze Cheng, Ed H. Chi, Quoc V. Le, Denny Zhou
2024	A*	`conf`	Teaching Large Language Models to Self-Debug. ICLR Xinyun Chen, Maxwell Lin, Nathanael Schärli, Denny Zhou
2024	J	`jnl`	Transformers Can Achieve Length Generalization But Not Robustly. CoRR Yongchao Zhou, Uri Alon, Xinyun Chen, Xuezhi Wang, Rishabh Agarwal, Denny Zhou
2023	J	`jnl`	A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity. CoRR Shayne Longpre, Gregory Yauney, Emily Reif, Katherine Lee, Adam Roberts, Barret Zoph, Denny Zhou, Jason Wei, Kevin Robinson, David Mimno, Daphne Ippolito
2023	—	`conf`	Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them. ACL (Findings) Mirac Suzgun, Nathan Scales, Nathanael Schärli, Sebastian Gehrmann, Yi Tay, Hyung Won Chung, Aakanksha Chowdhery, Quoc V. Le, Ed H. Chi, Denny Zhou, Jason Wei
2023	A*	`conf`	Compositional Semantic Parsing with Large Language Models. ICLR Andrew Drozdov, Nathanael Schärli, Ekin Akyürek, Nathan Scales, Xinying Song, Xinyun Chen, Olivier Bousquet, Denny Zhou
2023	J	`jnl`	Flan-MoE: Scaling Instruction-Finetuned Language Models with Sparse Mixture of Experts. CoRR Sheng Shen, Le Hou, Yanqi Zhou, Nan Du, Shayne Longpre, Jason Wei, Hyung Won Chung, Barret Zoph, William Fedus, Xinyun Chen, Tu Vu, Yuexin Wu, Wuyang Chen, Albert Webson, Yunxuan Li, Vincent Y. Zhao, Hongkun Yu, Kurt Keutzer, Trevor Darrell, Denny Zhou
2023	J	`jnl`	FreshLLMs: Refreshing Large Language Models with Search Engine Augmentation. CoRR Tu Vu, Mohit Iyyer, Xuezhi Wang, Noah Constant, Jerry W. Wei, Jason Wei, Chris Tar, Yun-Hsuan Sung, Denny Zhou, Quoc V. Le, Thang Luong
2023	J	`jnl`	Instruction-Following Evaluation for Large Language Models. CoRR Jeffrey Zhou, Tianjian Lu, Swaroop Mishra, Siddhartha Brahma, Sujoy Basu, Yi Luan, Denny Zhou, Le Hou
2023	A*	`conf`	Language models are multilingual chain-of-thought reasoners. ICLR Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, Jason Wei
2023	A*	`conf`	Large Language Models Can Be Easily Distracted by Irrelevant Context. ICML Freda Shi, Xinyun Chen, Kanishka Misra, Nathan Scales, David Dohan, Ed H. Chi, Nathanael Schärli, Denny Zhou
2023	J	`jnl`	Large Language Models Can Be Easily Distracted by Irrelevant Context. CoRR Freda Shi, Xinyun Chen, Kanishka Misra, Nathan Scales, David Dohan, Ed H. Chi, Nathanael Schärli, Denny Zhou
2023	J	`jnl`	Large Language Models Cannot Self-Correct Reasoning Yet. CoRR Jie Huang, Xinyun Chen, Swaroop Mishra, Huaixiu Steven Zheng, Adams Wei Yu, Xinying Song, Denny Zhou
2023	J	`jnl`	Large Language Models as Analogical Reasoners. CoRR Michihiro Yasunaga, Xinyun Chen, Yujia Li, Panupong Pasupat, Jure Leskovec, Percy Liang, Ed H. Chi, Denny Zhou
2023	J	`jnl`	Large Language Models as Optimizers. CoRR Chengrun Yang, Xuezhi Wang, Yifeng Lu, Hanxiao Liu, Quoc V. Le, Denny Zhou, Xinyun Chen
2023	J	`jnl`	Large Language Models as Tool Makers. CoRR Tianle Cai, Xuezhi Wang, Tengyu Ma, Xinyun Chen, Denny Zhou
2023	J	`jnl`	Large Language Models can Learn Rules. CoRR Zhaocheng Zhu, Yuan Xue, Xinyun Chen, Denny Zhou, Jian Tang, Dale Schuurmans, Hanjun Dai
2023	J	`jnl`	Larger language models do in-context learning differently. CoRR Jerry W. Wei, Jason Wei, Yi Tay, Dustin Tran, Albert Webson, Yifeng Lu, Xinyun Chen, Hanxiao Liu, Da Huang, Denny Zhou, Tengyu Ma
2023	A*	`conf`	Least-to-Most Prompting Enables Complex Reasoning in Large Language Models. ICLR Denny Zhou, Nathanael Schärli, Le Hou, Jason Wei, Nathan Scales, Xuezhi Wang, Dale Schuurmans, Claire Cui, Olivier Bousquet, Quoc V. Le, Ed H. Chi
2023	A*	`conf`	Mind's Eye: Grounded Language Model Reasoning through Simulation. ICLR Ruibo Liu, Jason Wei, Shixiang Shane Gu, Te-yen Wu, Soroush Vosoughi, Claire Cui, Denny Zhou, Andrew M. Dai
2023	A*	`conf`	Not All Semantics are Created Equal: Contrastive Self-supervised Learning with Automatic Temperature Individualization. ICML Zi-Hao Qiu, Quanqi Hu, Zhuoning Yuan, Denny Zhou, Lijun Zhang, Tianbao Yang
2023	J	`jnl`	Not All Semantics are Created Equal: Contrastive Self-supervised Learning with Automatic Temperature Individualization. CoRR Zi-Hao Qiu, Quanqi Hu, Zhuoning Yuan, Denny Zhou, Lijun Zhang, Tianbao Yang
2023	J	`jnl`	PaLM: Scaling Language Modeling with Pathways. J. Mach. Learn. Res. Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel
2023	A*	`conf`	Recitation-Augmented Language Models. ICLR Zhiqing Sun, Xuezhi Wang, Yi Tay, Yiming Yang, Denny Zhou
2023	A*	`conf`	Self-Consistency Improves Chain of Thought Reasoning in Language Models. ICLR Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le, Ed H. Chi, Sharan Narang, Aakanksha Chowdhery, Denny Zhou
2023	J	`jnl`	Simple synthetic data reduces sycophancy in large language models. CoRR Jerry W. Wei, Da Huang, Yifeng Lu, Denny Zhou, Quoc V. Le
2023	A*	`conf`	Symbol tuning improves in-context learning in language models. EMNLP Jerry W. Wei, Le Hou, Andrew K. Lampinen, Xiangning Chen, Da Huang, Yi Tay, Xinyun Chen, Yifeng Lu, Denny Zhou, Tengyu Ma, Quoc V. Le
2023	J	`jnl`	Symbol tuning improves in-context learning in language models. CoRR Jerry W. Wei, Le Hou, Andrew K. Lampinen, Xiangning Chen, Da Huang, Yi Tay, Xinyun Chen, Yifeng Lu, Denny Zhou, Tengyu Ma, Quoc V. Le
2023	A*	`conf`	TEMPERA: Test-Time Prompt Editing via Reinforcement Learning. ICLR Tianjun Zhang, Xuezhi Wang, Denny Zhou, Dale Schuurmans, Joseph E. Gonzalez
2023	J	`jnl`	Take a Step Back: Evoking Reasoning via Abstraction in Large Language Models. CoRR Huaixiu Steven Zheng, Swaroop Mishra, Xinyun Chen, Heng-Tze Cheng, Ed H. Chi, Quoc V. Le, Denny Zhou
2023	J	`jnl`	Teaching Large Language Models to Self-Debug. CoRR Xinyun Chen, Maxwell Lin, Nathanael Schärli, Denny Zhou
2023	A*	`conf`	The Flan Collection: Designing Data and Methods for Effective Instruction Tuning. ICML Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V. Le, Barret Zoph, Jason Wei, Adam Roberts
2023	J	`jnl`	The Flan Collection: Designing Data and Methods for Effective Instruction Tuning. CoRR Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V. Le, Barret Zoph, Jason Wei, Adam Roberts
2023	J	`jnl`	Training Socially Aligned Language Models in Simulated Human Society. CoRR Ruibo Liu, Ruixin Yang, Chenyan Jia, Ge Zhang, Denny Zhou, Andrew M. Dai, Diyi Yang, Soroush Vosoughi
2023	A*	`conf`	Transcending Scaling Laws with 0.1% Extra Compute. EMNLP Yi Tay, Jason Wei, Hyung Won Chung, Vinh Q. Tran, David R. So, Siamak Shakeri, Xavier Garcia, Huaixiu Steven Zheng, Jinfeng Rao, Aakanksha Chowdhery, Denny Zhou, Donald Metzler, Slav Petrov, Neil Houlsby, Quoc V. Le, Mostafa Dehghani
2023	A*	`conf`	UL2: Unifying Language Learning Paradigms. ICLR Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Xavier Garcia, Jason Wei, Xuezhi Wang, Hyung Won Chung, Dara Bahri, Tal Schuster, Huaixiu Steven Zheng, Denny Zhou, Neil Houlsby, Donald Metzler
2023	J	`jnl`	Universal Self-Consistency for Large Language Model Generation. CoRR Xinyun Chen, Renat Aksitov, Uri Alon, Jie Ren, Kefan Xiao, Pengcheng Yin, Sushant Prakash, Charles Sutton, Xuezhi Wang, Denny Zhou
2023	A*	`conf`	What learning algorithm is in-context learning? Investigations with linear models. ICLR Ekin Akyürek, Dale Schuurmans, Jacob Andreas, Tengyu Ma, Denny Zhou
2022	—	`conf`	A Simple Single-Scale Vision Transformer for Object Detection and Instance Segmentation. ECCV (10) Wuyang Chen, Xianzhi Du, Fan Yang, Lucas Beyer, Xiaohua Zhai, Tsung-Yi Lin, Huizhong Chen, Jing Li, Xiaodan Song, Zhangyang Wang, Denny Zhou
2022	A*	`conf`	Auto-scaling Vision Transformers without Training. ICLR Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wang, Denny Zhou
2022	J	`jnl`	Auto-scaling Vision Transformers without Training. CoRR Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wang, Denny Zhou
2022	A*	`conf`	Back Razor: Memory-Efficient Transfer Learning by Self-Sparsified Backpropagation. NeurIPS Ziyu Jiang, Xuxi Chen, Xueqin Huang, Xianzhi Du, Denny Zhou, Zhangyang Wang
2022	J	`jnl`	Chain of Thought Prompting Elicits Reasoning in Large Language Models. CoRR Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Ed H. Chi, Quoc Le, Denny Zhou
2022	A*	`conf`	Chain-of-Thought Prompting Elicits Reasoning in Large Language Models. NeurIPS Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed H. Chi, Quoc V. Le, Denny Zhou
2022	J	`jnl`	Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them. CoRR Mirac Suzgun, Nathan Scales, Nathanael Schärli, Sebastian Gehrmann, Yi Tay, Hyung Won Chung, Aakanksha Chowdhery, Quoc V. Le, Ed H. Chi, Denny Zhou, Jason Wei
2022	J	`jnl`	Compositional Semantic Parsing with Large Language Models. CoRR Andrew Drozdov, Nathanael Schärli, Ekin Akyürek, Nathan Scales, Xinying Song, Xinyun Chen, Olivier Bousquet, Denny Zhou
2022	A*	`conf`	DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detection. CVPR Yingwei Li, Adams Wei Yu, Tianjian Meng, Benjamin Caine, Jiquan Ngiam, Daiyi Peng, Junyang Shen, Yifeng Lu, Denny Zhou, Quoc V. Le, Alan L. Yuille, Mingxing Tan
2022	J	`jnl`	DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detection. CoRR Yingwei Li, Adams Wei Yu, Tianjian Meng, Benjamin Caine, Jiquan Ngiam, Daiyi Peng, Junyang Shen, Bo Wu, Yifeng Lu, Denny Zhou, Quoc V. Le, Alan L. Yuille, Mingxing Tan
2022	J	`jnl`	Emergent Abilities of Large Language Models. CoRR Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, William Fedus
2022	J	`jnl`	Emergent Abilities of Large Language Models. Trans. Mach. Learn. Res. Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, William Fedus
2022	J	`jnl`	Language Models are Multilingual Chain-of-Thought Reasoners. CoRR Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, Jason Wei
2022	J	`jnl`	Least-to-Most Prompting Enables Complex Reasoning in Large Language Models. CoRR Denny Zhou, Nathanael Schärli, Le Hou, Jason Wei, Nathan Scales, Xuezhi Wang, Dale Schuurmans, Olivier Bousquet, Quoc Le, Ed H. Chi
2022	J	`jnl`	Mind's Eye: Grounded Language Model Reasoning through Simulation. CoRR Ruibo Liu, Jason Wei, Shixiang Shane Gu, Te-yen Wu, Soroush Vosoughi, Claire Cui, Denny Zhou, Andrew M. Dai
2022	J	`jnl`	PaLM: Scaling Language Modeling with Pathways. CoRR Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel
2022	A*	`conf`	Provable Stochastic Optimization for Global Contrastive Learning: Small Batch Does Not Harm Performance. ICML Zhuoning Yuan, Yuexin Wu, Zi-Hao Qiu, Xianzhi Du, Lijun Zhang, Denny Zhou, Tianbao Yang
2022	J	`jnl`	Provable Stochastic Optimization for Global Contrastive Learning: Small Batch Does Not Harm Performance. CoRR Zhuoning Yuan, Yuexin Wu, Zi-Hao Qiu, Xianzhi Du, Lijun Zhang, Denny Zhou, Tianbao Yang
2022	J	`jnl`	Rationale-Augmented Ensembles in Language Models. CoRR Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le, Ed H. Chi, Denny Zhou
2022	J	`jnl`	Recitation-Augmented Language Models. CoRR Zhiqing Sun, Xuezhi Wang, Yi Tay, Yiming Yang, Denny Zhou
2022	A*	`conf`	SMORE: Knowledge Graph Completion and Multi-hop Reasoning in Massive Knowledge Graphs. KDD Hongyu Ren, Hanjun Dai, Bo Dai, Xinyun Chen, Denny Zhou, Jure Leskovec, Dale Schuurmans
2022	J	`jnl`	Scaling Instruction-Finetuned Language Models. CoRR Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Eric Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Y. Zhao, Yanping Huang, Andrew M. Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei
2022	J	`jnl`	Self-Consistency Improves Chain of Thought Reasoning in Language Models. CoRR Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le, Ed H. Chi, Denny Zhou
2022	J	`jnl`	TEMPERA: Test-Time Prompting via Reinforcement Learning. CoRR Tianjun Zhang, Xuezhi Wang, Denny Zhou, Dale Schuurmans, Joseph E. Gonzalez
2022	—	`conf`	Token Dropping for Efficient BERT Pretraining. ACL (1) Le Hou, Richard Yuanzhe Pang, Tianyi Zhou, Yuexin Wu, Xinying Song, Xiaodan Song, Denny Zhou
2022	J	`jnl`	Token Dropping for Efficient BERT Pretraining. CoRR Le Hou, Richard Yuanzhe Pang, Tianyi Zhou, Yuexin Wu, Xinying Song, Xiaodan Song, Denny Zhou
2022	J	`jnl`	Transcending Scaling Laws with 0.1% Extra Compute. CoRR Yi Tay, Jason Wei, Hyung Won Chung, Vinh Q. Tran, David R. So, Siamak Shakeri, Xavier Garcia, Huaixiu Steven Zheng, Jinfeng Rao, Aakanksha Chowdhery, Denny Zhou, Donald Metzler, Slav Petrov, Neil Houlsby, Quoc V. Le, Mostafa Dehghani
2022	J	`jnl`	What learning algorithm is in-context learning? Investigations with linear models. CoRR Ekin Akyürek, Dale Schuurmans, Jacob Andreas, Tengyu Ma, Denny Zhou
2021	J	`jnl`	A Simple Single-Scale Vision Transformer for Object Localization and Instance Segmentation. CoRR Wuyang Chen, Xianzhi Du, Fan Yang, Lucas Beyer, Xiaohua Zhai, Tsung-Yi Lin, Huizhong Chen, Jing Li, Xiaodan Song, Zhangyang Wang, Denny Zhou
2021	A	`conf`	Extremely Small BERT Models from Mixed-Vocabulary Training. EACL Sanqiang Zhao, Raghav Gupta, Yang Song, Denny Zhou
2021	—	`conf`	Fast WordPiece Tokenization. EMNLP (1) Xinying Song, Alex Salcianu, Yang Song, Dave Dopson, Denny Zhou
2021	A*	`conf`	LEGO: Latent Execution-Guided Reasoning for Multi-Hop Question Answering on Knowledge Graphs. ICML Hongyu Ren, Hanjun Dai, Bo Dai, Xinyun Chen, Michihiro Yasunaga, Haitian Sun, Dale Schuurmans, Jure Leskovec, Denny Zhou
2021	J	`jnl`	SMORE: Knowledge Graph Completion and Multi-hop Reasoning in Massive Knowledge Graphs. CoRR Hongyu Ren, Hanjun Dai, Bo Dai, Xinyun Chen, Denny Zhou, Jure Leskovec, Dale Schuurmans
2021	J	`jnl`	Speeding up Deep Model Training by Sharing Weights and Then Unsharing. CoRR Shuo Yang, Le Hou, Xiaodan Song, Qiang Liu, Denny Zhou
2021	A*	`conf`	SpreadsheetCoder: Formula Prediction from Semi-structured Context. ICML Xinyun Chen, Petros Maniatis, Rishabh Singh, Charles Sutton, Hanjun Dai, Max Lin, Denny Zhou
2021	J	`jnl`	SpreadsheetCoder: Formula Prediction from Semi-structured Context. CoRR Xinyun Chen, Petros Maniatis, Rishabh Singh, Charles Sutton, Hanjun Dai, Max Lin, Denny Zhou
2020	A*	`conf`	Black-box Off-policy Estimation for Infinite-Horizon Reinforcement Learning. ICLR Ali Mousavi, Lihong Li, Qiang Liu, Denny Zhou
2020	J	`jnl`	Black-box Off-policy Estimation for Infinite-Horizon Reinforcement Learning. CoRR Ali Mousavi, Lihong Li, Qiang Liu, Denny Zhou
2020	A*	`conf`	Compositional Generalization via Neural-Symbolic Stack Machines. NeurIPS Xinyun Chen, Chen Liang, Adams Wei Yu, Dawn Song, Denny Zhou
2020	J	`jnl`	Compositional Generalization via Neural-Symbolic Stack Machines. CoRR Xinyun Chen, Chen Liang, Adams Wei Yu, Dawn Song, Denny Zhou
2020	A*	`conf`	Deep State-Space Generative Model For Correlated Time-to-Event Predictions. KDD Yuan Xue, Denny Zhou, Nan Du, Andrew M. Dai, Zhen Xu, Kun Zhang, Claire Cui
2020	A*	`conf`	Go Wide, Then Narrow: Efficient Training of Deep Thin Networks. ICML Denny Zhou, Mao Ye, Chen Chen, Tianjian Meng, Mingxing Tan, Xiaodan Song, Quoc V. Le, Qiang Liu, Dale Schuurmans
2020	J	`jnl`	Go Wide, Then Narrow: Efficient Training of Deep Thin Networks. CoRR Denny Zhou, Mao Ye, Chen Chen, Tianjian Meng, Mingxing Tan, Xiaodan Song, Quoc V. Le, Qiang Liu, Dale Schuurmans
2020	A*	`conf`	Good Subnetworks Provably Exist: Pruning via Greedy Forward Selection. ICML Mao Ye, Chengyue Gong, Lizhen Nie, Denny Zhou, Adam R. Klivans, Qiang Liu
2020	J	`jnl`	Good Subnetworks Provably Exist: Pruning via Greedy Forward Selection. CoRR Mao Ye, Chengyue Gong, Lizhen Nie, Denny Zhou, Adam R. Klivans, Qiang Liu
2020	J	`jnl`	Linear-Time WordPiece Tokenization. CoRR Xinying Song, Alex Salcianu, Yang Song, Dave Dopson, Denny Zhou
2020	A*	`conf`	MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices. ACL Zhiqing Sun, Hongkun Yu, Xiaodan Song, Renjie Liu, Yiming Yang, Denny Zhou
2020	J	`jnl`	MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices. CoRR Zhiqing Sun, Hongkun Yu, Xiaodan Song, Renjie Liu, Yiming Yang, Denny Zhou
2020	A*	`conf`	Neural Symbolic Reader: Scalable Integration of Distributed and Symbolic Representations for Reading Comprehension. ICLR Xinyun Chen, Chen Liang, Adams Wei Yu, Denny Zhou, Dawn Song, Quoc V. Le
2019	J	`jnl`	Deep Physiological State Space Model for Clinical Forecasting. CoRR Yuan Xue, Denny Zhou, Nan Du, Andrew M. Dai, Zhen Xu, Kun Zhang, Claire Cui
2019	J	`jnl`	Doubly Sparse: Sparse Mixture of Sparse Experts for Efficient Softmax Inference. CoRR Shun Liao, Ting Chen, Tian Lin, Denny Zhou, Chong Wang
2019	J	`jnl`	Extreme Language Model Compression with Optimal Subwords and Shared Projections. CoRR Sanqiang Zhao, Raghav Gupta, Yang Song, Denny Zhou
2019	—	`conf`	Neural Logic Machines. ICLR (Poster) Honghua Dong, Jiayuan Mao, Tian Lin, Chong Wang, Lihong Li, Denny Zhou
2019	J	`jnl`	Neural Logic Machines. CoRR Honghua Dong, Jiayuan Mao, Tian Lin, Chong Wang, Lihong Li, Denny Zhou
2015	—	`conf`	Double or Nothing: Multiplicative Incentive Mechanisms for Crowdsourcing. NIPS Nihar Bhadresh Shah, Denny Zhou