Yi Tay

193 papers A* 63A 8Journal 100Unranked 20
YearRankTypeTitle / Venue / Authors
2026 J jnl
Towards Autonomous Mathematics Research.
CoRR
Tony Feng, Trieu H. Trinh, Garrett Bingham, Dawsen Hwang, Yuri Chervonyi, Junehyuk Jung, Joonkyung Lee, Carlo Pagano, Sang-hyun Kim, Federico Pasqualotto, Sergei Gukov, Jonathan N. Lee, Junsu Kim, Kaiying Hou, Golnaz Ghiasi, Yi Tay, Yaguang Li, Chenkai Kuang, Yuan Liu, Hanzhao Lin, Evan Zheran Liu, Nigamaa Nayakanti, Xiaomeng Yang, Heng-Tze Cheng, Demis Hassabis, Koray Kavukcuoglu, Quoc V. Le, Thang Luong
2025 — conf
BIG-Bench Extra Hard.
ACL (1)
Mehran Kazemi, Bahare Fatemi, Hritik Bansal, John Palowitch, Chrysovalantis Anastasiou, Sanket Vaibhav Mehta, Lalit K. Jain, Virginia Aglietti, Disha Jindal, Peter Chen, Nishanth Dikkala, Gladys Tyen, Xin Liu, Uri Shalit, Silvia Chiappa, Kate Olszewska, Yi Tay, Vinh Q. Tran, Quoc V. Le, Orhan Firat
2025 J jnl
BIG-Bench Extra Hard.
CoRR
Mehran Kazemi, Bahare Fatemi, Hritik Bansal, John Palowitch, Chrysovalantis Anastasiou, Sanket Vaibhav Mehta, Kshitij Jain, Virginia Aglietti, Disha Jindal, Peter Chen, Nishanth Dikkala, Gladys Tyen, Xin Liu, Uri Shalit, Silvia Chiappa, Kate Olszewska, Yi Tay, Vinh Q. Tran, Quoc V. Le, Orhan Firat
2024 A* conf
On Scaling Up a Multilingual Vision and Language Model.
CVPR
Xi Chen, Josip Djolonga, Piotr Padlewski, Basil Mustafa, Soravit Changpinyo, Jialin Wu, Carlos Riquelme Ruiz, Sebastian Goodman, Xiao Wang, Yi Tay, Siamak Shakeri, Mostafa Dehghani, Daniel Salz, Mario Lucic, Michael Tschannen, Arsha Nagrani, Hexiang Hu, Mandar Joshi, Bo Pang, Ceslee Montgomery, Paulina Pietrzyk, Marvin Ritter, A. J. Piergiovanni, Matthias Minderer, Filip Pavetic, Austin Waters, Gang Li, Ibrahim Alabdulmohsin, Lucas Beyer, Julien Amelot, Kenton Lee, Andreas Peter Steiner, Yang Li, Daniel Keysers, Anurag Arnab, Yuanzhong Xu, Keran Rong, Alexander Kolesnikov, Mojtaba Seyedhosseini, Anelia Angelova, Xiaohua Zhai, Neil Houlsby, Radu Soricut
2024 J jnl
Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models.
CoRR
Aitor Ormazabal, Che Zheng, Cyprien de Masson d'Autume, Dani Yogatama, Deyu Fu, Donovan Ong, Eric Chen, Eugenie Lamprecht, Hai Pham, Isaac Ong, Kaloyan Aleksiev, Lei Li, Matthew Henderson, Max Bain, Mikel Artetxe, Nishant Relan, Piotr Padlewski, Qi Liu, Ren Chen, Samuel Phua, Yazheng Yang, Yi Tay, Yuqi Wang, Zhongkai Zhu, Zhihui Xie
2024 J jnl
Scaling Instruction-Finetuned Language Models.
J. Mach. Learn. Res.
Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Alex Castro-Ros, Marie Pellat, Kevin Robinson, Dasha Valter, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Y. Zhao, Yanping Huang, Andrew M. Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei
2024 J jnl
Vibe-Eval: A hard evaluation suite for measuring progress of multimodal language models.
CoRR
Piotr Padlewski, Max Bain, Matthew Henderson, Zhongkai Zhu, Nishant Relan, Hai Pham, Donovan Ong, Kaloyan Aleksiev, Aitor Ormazabal, Samuel Phua, Ethan Yeo, Eugenie Lamprecht, Qi Liu, Yuqi Wang, Eric Chen, Deyu Fu, Lei Li, Che Zheng, Cyprien de Masson d'Autume, Dani Yogatama, Mikel Artetxe, Yi Tay
2023 — conf
Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them.
ACL (Findings)
Mirac Suzgun, Nathan Scales, Nathanael Schärli, Sebastian Gehrmann, Yi Tay, Hyung Won Chung, Aakanksha Chowdhery, Quoc V. Le, Ed H. Chi, Denny Zhou, Jason Wei
2023 A* conf
CoLT5: Faster Long-Range Transformers with Conditional Computation.
EMNLP
Joshua Ainslie, Tao Lei, Michiel de Jong, Santiago Ontañón, Siddhartha Brahma, Yury Zemlyanskiy, David C. Uthus, Mandy Guo, James Lee-Thorp, Yi Tay, Yun-Hsuan Sung, Sumit Sanghai
2023 J jnl
CoLT5: Faster Long-Range Transformers with Conditional Computation.
CoRR
Joshua Ainslie, Tao Lei, Michiel de Jong, Santiago Ontañón, Siddhartha Brahma, Yury Zemlyanskiy, David C. Uthus, Mandy Guo, James Lee-Thorp, Yi Tay, Yun-Hsuan Sung, Sumit Sanghai
2023 A* conf
DSI++: Updating Transformer Memory with New Documents.
EMNLP
Sanket Vaibhav Mehta, Jai Gupta, Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Jinfeng Rao, Marc Najork, Emma Strubell, Donald Metzler
2023 J jnl
Efficient Transformers: A Survey.
ACM Comput. Surv.
Yi Tay, Mostafa Dehghani, Dara Bahri, Donald Metzler
2023 A* conf
Inverse Scaling Can Become U-Shaped.
EMNLP
Jason Wei, Najoung Kim, Yi Tay, Quoc V. Le
2023 A* conf
Language models are multilingual chain-of-thought reasoners.
ICLR
Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, Jason Wei
2023 J jnl
Larger language models do in-context learning differently.
CoRR
Jerry W. Wei, Jason Wei, Yi Tay, Dustin Tran, Albert Webson, Yifeng Lu, Xinyun Chen, Hanxiao Liu, Da Huang, Denny Zhou, Tengyu Ma
2023 J jnl
PaLI-X: On Scaling up a Multilingual Vision and Language Model.
CoRR
Xi Chen, Josip Djolonga, Piotr Padlewski, Basil Mustafa, Soravit Changpinyo, Jialin Wu, Carlos Riquelme Ruiz, Sebastian Goodman, Xiao Wang, Yi Tay, Siamak Shakeri, Mostafa Dehghani, Daniel Salz, Mario Lucic, Michael Tschannen, Arsha Nagrani, Hexiang Hu, Mandar Joshi, Bo Pang, Ceslee Montgomery, Paulina Pietrzyk, Marvin Ritter, A. J. Piergiovanni, Matthias Minderer, Filip Pavetic, Austin Waters, Gang Li, Ibrahim Alabdulmohsin, Lucas Beyer, Julien Amelot, Kenton Lee, Andreas Peter Steiner, Yang Li, Daniel Keysers, Anurag Arnab, Yuanzhong Xu, Keran Rong, Alexander Kolesnikov, Mojtaba Seyedhosseini, Anelia Angelova, Xiaohua Zhai, Neil Houlsby, Radu Soricut
2023 J jnl
PaLM 2 Technical Report.
CoRR
Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, Eric Chu, Jonathan H. Clark, Laurent El Shafey, Yanping Huang, Kathy Meier-Hellstern, Gaurav Mishra, Erica Moreira, Mark Omernick, Kevin Robinson, Sebastian Ruder, Yi Tay, Kefan Xiao, Yuanzhong Xu, Yujing Zhang, Gustavo Hernández Ábrego, Junwhan Ahn, Jacob Austin, Paul Barham, Jan A. Botha, James Bradbury, Siddhartha Brahma, Kevin Brooks, Michele Catasta, Yong Cheng, Colin Cherry, Christopher A. Choquette-Choo, Aakanksha Chowdhery, Clément Crepy, Shachi Dave, Mostafa Dehghani, Sunipa Dev, Jacob Devlin, Mark Díaz, Nan Du, Ethan Dyer, Vladimir Feinberg, Fangxiaoyu Feng, Vlad Fienber, Markus Freitag, Xavier Garcia, Sebastian Gehrmann, Lucas Gonzalez, et al.
2023 J jnl
PaLM: Scaling Language Modeling with Pathways.
J. Mach. Learn. Res.
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel
2023 J jnl
PolyViT: Co-training Vision Transformers on Images, Videos and Audio.
Trans. Mach. Learn. Res.
Valerii Likhosherstov, Anurag Arnab, Krzysztof Marcin Choromanski, Mario Lucic, Yi Tay, Mostafa Dehghani
2023 A* conf
Recitation-Augmented Language Models.
ICLR
Zhiqing Sun, Xuezhi Wang, Yi Tay, Yiming Yang, Denny Zhou
2023 A* conf
Recommender Systems with Generative Retrieval.
NeurIPS
Shashank Rajput, Nikhil Mehta, Anima Singh, Raghunandan Hulikal Keshavan, Trung Vu, Lukasz Heldt, Lichan Hong, Yi Tay, Vinh Q. Tran, Jonah Samost, Maciej Kula, Ed H. Chi, Mahesh Sathiamoorthy
2023 J jnl
Recommender Systems with Generative Retrieval.
CoRR
Shashank Rajput, Nikhil Mehta, Anima Singh, Raghunandan H. Keshavan, Trung Vu, Lukasz Heldt, Lichan Hong, Yi Tay, Vinh Q. Tran, Jonah Samost, Maciej Kula, Ed H. Chi, Maheswaran Sathiamoorthy
2023 — conf
Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
EMNLP (Findings)
Yi Tay, Mostafa Dehghani, Samira Abnar, Hyung Won Chung, William Fedus, Jinfeng Rao, Sharan Narang, Vinh Q. Tran, Dani Yogatama, Donald Metzler
2023 A* conf
Scaling Vision Transformers to 22 Billion Parameters.
ICML
Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Peter Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme Ruiz, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar, Sjoerd van Steenkiste, Gamaleldin Fathy Elsayed, Aravindh Mahendran, Fisher Yu, Avital Oliver, Fantine Huot, Jasmijn Bastings, Mark Collier, Alexey A. Gritsenko, Vighnesh Birodkar, Cristina Nader Vasconcelos, Yi Tay, Thomas Mensink, Alexander Kolesnikov, Filip Pavetic, Dustin Tran, Thomas Kipf, Mario Lucic, Xiaohua Zhai, Daniel Keysers, Jeremiah J. Harmsen, Neil Houlsby
2023 J jnl
Scaling Vision Transformers to 22 Billion Parameters.
CoRR
Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar, Sjoerd van Steenkiste, Gamaleldin F. Elsayed, Aravindh Mahendran, Fisher Yu, Avital Oliver, Fantine Huot, Jasmijn Bastings, Mark Patrick Collier, Alexey A. Gritsenko, Vighnesh Birodkar, Cristina Nader Vasconcelos, Yi Tay, Thomas Mensink, Alexander Kolesnikov, Filip Pavetic, Dustin Tran, Thomas Kipf, Mario Lucic, Xiaohua Zhai, Daniel Keysers, Jeremiah Harmsen, Neil Houlsby
2023 A* conf
Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints.
ICLR
Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, Carlos Riquelme Ruiz, Basil Mustafa, Joshua Ainslie, Yi Tay, Mostafa Dehghani, Neil Houlsby
2023 A* conf
Surprise: Result List Truncation via Extreme Value Theory.
SIGIR
Dara Bahri, Che Zheng, Yi Tay, Donald Metzler, Andrew Tomkins
2023 A* conf
Symbol tuning improves in-context learning in language models.
EMNLP
Jerry W. Wei, Le Hou, Andrew K. Lampinen, Xiangning Chen, Da Huang, Yi Tay, Xinyun Chen, Yifeng Lu, Denny Zhou, Tengyu Ma, Quoc V. Le
2023 J jnl
Symbol tuning improves in-context learning in language models.
CoRR
Jerry W. Wei, Le Hou, Andrew K. Lampinen, Xiangning Chen, Da Huang, Yi Tay, Xinyun Chen, Yifeng Lu, Denny Zhou, Tengyu Ma, Quoc V. Le
2023 A* conf
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning.
ICML
Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V. Le, Barret Zoph, Jason Wei, Adam Roberts
2023 J jnl
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning.
CoRR
Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V. Le, Barret Zoph, Jason Wei, Adam Roberts
2023 A* conf
Transcending Scaling Laws with 0.1% Extra Compute.
EMNLP
Yi Tay, Jason Wei, Hyung Won Chung, Vinh Q. Tran, David R. So, Siamak Shakeri, Xavier Garcia, Huaixiu Steven Zheng, Jinfeng Rao, Aakanksha Chowdhery, Denny Zhou, Donald Metzler, Slav Petrov, Neil Houlsby, Quoc V. Le, Mostafa Dehghani
2023 A* conf
UL2: Unifying Language Learning Paradigms.
ICLR
Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Xavier Garcia, Jason Wei, Xuezhi Wang, Hyung Won Chung, Dara Bahri, Tal Schuster, Huaixiu Steven Zheng, Denny Zhou, Neil Houlsby, Donald Metzler
2023 A* conf
UniMax: Fairer and More Effective Language Sampling for Large-Scale Multilingual Pretraining.
ICLR
Hyung Won Chung, Xavier Garcia, Adam Roberts, Yi Tay, Orhan Firat, Sharan Narang, Noah Constant
2023 J jnl
UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretraining.
CoRR
Hyung Won Chung, Noah Constant, Xavier Garcia, Adam Roberts, Yi Tay, Sharan Narang, Orhan Firat
2022 A* conf
A New Generation of Perspective API: Efficient Multilingual Character-level Transformers.
KDD
Alyssa Lees, Vinh Q. Tran, Yi Tay, Jeffrey Sorensen, Jai Prakash Gupta, Donald Metzler, Lucy Vasserman
2022 J jnl
A New Generation of Perspective API: Efficient Multilingual Character-level Transformers.
CoRR
Alyssa Lees, Vinh Q. Tran, Yi Tay, Jeffrey Sorensen, Jai Prakash Gupta, Donald Metzler, Lucy Vasserman
2022 J jnl
Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them.
CoRR
Mirac Suzgun, Nathan Scales, Nathanael Schärli, Sebastian Gehrmann, Yi Tay, Hyung Won Chung, Aakanksha Chowdhery, Quoc V. Le, Ed H. Chi, Denny Zhou, Jason Wei
2022 A* conf
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization.
ICLR
Yi Tay, Vinh Q. Tran, Sebastian Ruder, Jai Prakash Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, Donald Metzler
2022 A* conf
Confident Adaptive Language Modeling.
NeurIPS
Tal Schuster, Adam Fisch, Jai Gupta, Mostafa Dehghani, Dara Bahri, Vinh Tran, Yi Tay, Donald Metzler
2022 J jnl
Confident Adaptive Language Modeling.
CoRR
Tal Schuster, Adam Fisch, Jai Prakash Gupta, Mostafa Dehghani, Dara Bahri, Vinh Q. Tran, Yi Tay, Donald Metzler
2022 J jnl
DSI++: Updating Transformer Memory with New Documents.
CoRR
Sanket Vaibhav Mehta, Jai Prakash Gupta, Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Jinfeng Rao, Marc Najork, Emma Strubell, Donald Metzler
2022 — ch.
Deep Learning for Recommender Systems.
Recommender Systems Handbook
Shuai Zhang, Yi Tay, Lina Yao, Aixin Sun, Ce Zhang
2022 — conf
Dense Feature Memory Augmented Transformers for COVID-19 Vaccination Search Classification.
EMNLP (Industry Track)
Jai Gupta, Yi Tay, Chaitanya Kamath, Vinh Tran, Donald Metzler, Shailesh Bavadekar, Mimi Sun, Evgeniy Gabrilovich
2022 J jnl
Dense Feature Memory Augmented Transformers for COVID-19 Vaccination Search Classification.
CoRR
Jai Gupta, Yi Tay, Chaitanya Kamath, Vinh Q. Tran, Donald Metzler, Shailesh Bavadekar, Mimi Sun, Evgeniy Gabrilovich
2022 — conf
ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference.
ACL (Findings)
Kai Hui, Honglei Zhuang, Tao Chen, Zhen Qin, Jing Lu, Dara Bahri, Ji Ma, Jai Prakash Gupta, Cícero Nogueira dos Santos, Yi Tay, Donald Metzler
2022 J jnl
ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference.
CoRR
Kai Hui, Honglei Zhuang, Tao Chen, Zhen Qin, Jing Lu, Dara Bahri, Ji Ma, Jai Prakash Gupta, Cícero Nogueira dos Santos, Yi Tay, Don Metzler
2022 J jnl
Emergent Abilities of Large Language Models.
CoRR
Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, William Fedus
2022 J jnl
Emergent Abilities of Large Language Models.
Trans. Mach. Learn. Res.
Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, William Fedus
2022 A* conf
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning.
ICLR
Vamsi Aribandi, Yi Tay, Tal Schuster, Jinfeng Rao, Huaixiu Steven Zheng, Sanket Vaibhav Mehta, Honglei Zhuang, Vinh Q. Tran, Dara Bahri, Jianmo Ni, Jai Prakash Gupta, Kai Hui, Sebastian Ruder, Donald Metzler
2022 A* conf
HyperPrompt: Prompt-based Task-Conditioning of Transformers.
ICML
Yun He, Huaixiu Steven Zheng, Yi Tay, Jai Prakash Gupta, Yu Du, Vamsi Aribandi, Zhe Zhao, Yaguang Li, Zhao Chen, Donald Metzler, Heng-Tze Cheng, Ed H. Chi
2022 J jnl
HyperPrompt: Prompt-based Task-Conditioning of Transformers.
CoRR
Yun He, Huaixiu Steven Zheng, Yi Tay, Jai Prakash Gupta, Yu Du, Vamsi Aribandi, Zhe Zhao, Yaguang Li, Zhao Chen, Donald Metzler, Heng-Tze Cheng, Ed H. Chi
2022 — conf
Improving Compositional Generalization with Self-Training for Data-to-Text Generation.
ACL (1)
Sanket Vaibhav Mehta, Jinfeng Rao, Yi Tay, Mihir Kale, Ankur Parikh, Emma Strubell
2022 J jnl
Inverse scaling can become U-shaped.
CoRR
Jason Wei, Yi Tay, Quoc V. Le
2022 J jnl
Language Models are Multilingual Chain-of-Thought Reasoners.
CoRR
Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, Jason Wei
2022 J jnl
PaLM: Scaling Language Modeling with Pathways.
CoRR
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel
2022 J jnl
Recitation-Augmented Language Models.
CoRR
Zhiqing Sun, Xuezhi Wang, Yi Tay, Yiming Yang, Denny Zhou
2022 A* conf
SCENIC: A JAX Library for Computer Vision Research and Beyond.
CVPR
Mostafa Dehghani, Alexey A. Gritsenko, Anurag Arnab, Matthias Minderer, Yi Tay
2022 A* conf
Scale Efficiently: Insights from Pretraining and Finetuning Transformers.
ICLR
Yi Tay, Mostafa Dehghani, Jinfeng Rao, William Fedus, Samira Abnar, Hyung Won Chung, Sharan Narang, Dani Yogatama, Ashish Vaswani, Donald Metzler
2022 J jnl
Scaling Instruction-Finetuned Language Models.
CoRR
Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Eric Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Y. Zhao, Yanping Huang, Andrew M. Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei
2022 J jnl
Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
CoRR
Yi Tay, Mostafa Dehghani, Samira Abnar, Hyung Won Chung, William Fedus, Jinfeng Rao, Sharan Narang, Vinh Q. Tran, Dani Yogatama, Donald Metzler
2022 A* conf
Scarf: Self-Supervised Contrastive Learning using Random Feature Corruption.
ICLR
Dara Bahri, Heinrich Jiang, Yi Tay, Donald Metzler
2022 — conf
Sharpness-Aware Minimization Improves Language Model Generalization.
ACL (1)
Dara Bahri, Hossein Mobahi, Yi Tay
2022 J jnl
Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints.
CoRR
Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, Carlos Riquelme Ruiz, Basil Mustafa, Joshua Ainslie, Yi Tay, Mostafa Dehghani, Neil Houlsby
2022 A* conf
The Efficiency Misnomer.
ICLR
Mostafa Dehghani, Yi Tay, Anurag Arnab, Lucas Beyer, Ashish Vaswani
2022 J jnl
Transcending Scaling Laws with 0.1% Extra Compute.
CoRR
Yi Tay, Jason Wei, Hyung Won Chung, Vinh Q. Tran, David R. So, Siamak Shakeri, Xavier Garcia, Huaixiu Steven Zheng, Jinfeng Rao, Aakanksha Chowdhery, Denny Zhou, Donald Metzler, Slav Petrov, Neil Houlsby, Quoc V. Le, Mostafa Dehghani
2022 A* conf
Transformer Memory as a Differentiable Search Index.
NeurIPS
Yi Tay, Vinh Tran, Mostafa Dehghani, Jianmo Ni, Dara Bahri, Harsh Mehta, Zhen Qin, Kai Hui, Zhe Zhao, Jai Prakash Gupta, Tal Schuster, William W. Cohen, Donald Metzler
2022 J jnl
Transformer Memory as a Differentiable Search Index.
CoRR
Yi Tay, Vinh Q. Tran, Mostafa Dehghani, Jianmo Ni, Dara Bahri, Harsh Mehta, Zhen Qin, Kai Hui, Zhe Zhao, Jai Prakash Gupta, Tal Schuster, William W. Cohen, Donald Metzler
2022 J jnl
Unifying Language Learning Paradigms.
CoRR
Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Xavier Garcia, Dara Bahri, Tal Schuster, Huaixiu Steven Zheng, Neil Houlsby, Donald Metzler
2021 A* conf
Are Neural Rankers still Outperformed by Gradient Boosted Decision Trees?
ICLR
Zhen Qin, Le Yan, Honglei Zhuang, Yi Tay, Rama Kumar Pasumarthi, Xuanhui Wang, Michael Bendersky, Marc Najork
2021 J jnl
Are Pre-trained Convolutions Better than Pre-trained Transformers?
CoRR
Yi Tay, Mostafa Dehghani, Jai Prakash Gupta, Dara Bahri, Vamsi Aribandi, Zhen Qin, Donald Metzler
2021 — conf
Are Pretrained Convolutions Better than Pretrained Transformers?
ACL/IJCNLP (1)
Yi Tay, Mostafa Dehghani, Jai Prakash Gupta, Vamsi Aribandi, Dara Bahri, Zhen Qin, Donald Metzler
2021 A* conf
Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with 1/n Parameters.
ICLR
Aston Zhang, Yi Tay, Shuai Zhang, Alvin Chan, Anh Tuan Luu, Siu Cheung Hui, Jie Fu
2021 J jnl
Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with 1/n Parameters.
CoRR
Aston Zhang, Yi Tay, Shuai Zhang, Alvin Chan, Anh Tuan Luu, Siu Cheung Hui, Jie Fu
2021 J jnl
Born Again Neural Rankers.
CoRR
Zhen Qin, Le Yan, Yi Tay, Honglei Zhuang, Xuanhui Wang, Michael Bendersky, Marc Najork
2021 J jnl
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization.
CoRR
Yi Tay, Vinh Q. Tran, Sebastian Ruder, Jai Prakash Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, Donald Metzler
2021 — conf
Do Transformer Modifications Transfer Across Implementations and Applications?
EMNLP (1)
Sharan Narang, Hyung Won Chung, Yi Tay, Liam Fedus, Thibault Févry, Michael Matena, Karishma Malkan, Noah Fiedel, Noam Shazeer, Zhenzhong Lan, Yanqi Zhou, Wei Li, Nan Ding, Jake Marcus, Adam Roberts, Colin Raffel
2021 J jnl
Do Transformer Modifications Transfer Across Implementations and Applications?
CoRR
Sharan Narang, Hyung Won Chung, Yi Tay, William Fedus, Thibault Févry, Michael Matena, Karishma Malkan, Noah Fiedel, Noam Shazeer, Zhenzhong Lan, Yanqi Zhou, Wei Li, Nan Ding, Jake Marcus, Adam Roberts, Colin Raffel
2021 J jnl
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning.
CoRR
Vamsi Aribandi, Yi Tay, Tal Schuster, Jinfeng Rao, Huaixiu Steven Zheng, Sanket Vaibhav Mehta, Honglei Zhuang, Vinh Q. Tran, Dara Bahri, Jianmo Ni, Jai Prakash Gupta, Kai Hui, Sebastian Ruder, Donald Metzler
2021 A conf
Generative Models are Unsupervised Predictors of Page Quality: A Colossal-Scale Study.
WSDM
Dara Bahri, Yi Tay, Che Zheng, Cliff Brunk, Donald Metzler, Andrew Tomkins
2021 — conf
How Reliable are Model Diagnostics?
ACL/IJCNLP (Findings)
Vamsi Aribandi, Yi Tay, Donald Metzler
2021 J jnl
How Reliable are Model Diagnostics?
CoRR
Vamsi Aribandi, Yi Tay, Donald Metzler
2021 A* conf
HyperGrid Transformers: Towards A Single Model for Multiple Tasks.
ICLR
Yi Tay, Zhe Zhao, Dara Bahri, Donald Metzler, Da-Cheng Juan
2021 J jnl
Improving Compositional Generalization with Self-Training for Data-to-Text Generation.
CoRR
Sanket Vaibhav Mehta, Jinfeng Rao, Yi Tay, Mihir Kale, Ankur Parikh, Hongtao Zhong, Emma Strubell
2021 — conf
Knowledge Router: Learning Disentangled Representations for Knowledge Graphs.
NAACL-HLT
Shuai Zhang, Xi Rao, Yi Tay, Ce Zhang
2021 J jnl
Label Smoothed Embedding Hypothesis for Out-of-Distribution Detection.
CoRR
Dara Bahri, Heinrich Jiang, Yi Tay, Donald Metzler
2021 A* conf
Long Range Arena : A Benchmark for Efficient Transformers.
ICLR
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler
2021 A* conf
OmniNet: Omnidirectional Representations from Transformers.
ICML
Yi Tay, Mostafa Dehghani, Vamsi Aribandi, Jai Prakash Gupta, Philip Pham, Zhen Qin, Dara Bahri, Da-Cheng Juan, Donald Metzler
2021 J jnl
OmniNet: Omnidirectional Representations from Transformers.
CoRR
Yi Tay, Mostafa Dehghani, Vamsi Aribandi, Jai Prakash Gupta, Philip Pham, Zhen Qin, Dara Bahri, Da-Cheng Juan, Donald Metzler
2021 — conf
On Orthogonality Constraints for Transformers.
ACL/IJCNLP (2)
Aston Zhang, Alvin Chan, Yi Tay, Jie Fu, Shuohang Wang, Shuai Zhang, Huajie Shao, Shuochao Yao, Roy Ka-Wei Lee
2021 J jnl
PolyViT: Co-training Vision Transformers on Images, Videos and Audio.
CoRR
Valerii Likhosherstov, Anurag Arnab, Krzysztof Choromanski, Mario Lucic, Yi Tay, Adrian Weller, Mostafa Dehghani
2021 J jnl
Rethinking Search: Making Experts out of Dilettantes.
CoRR
Donald Metzler, Yi Tay, Dara Bahri, Marc Najork
2021 J jnl
Rethinking search: making domain experts out of dilettantes.
SIGIR Forum
Donald Metzler, Yi Tay, Dara Bahri, Marc Najork
2021 J jnl
SCARF: Self-Supervised Contrastive Learning using Random Feature Corruption.
CoRR
Dara Bahri, Heinrich Jiang, Yi Tay, Donald Metzler
2021 J jnl
SCENIC: A JAX Library for Computer Vision Research and Beyond.
CoRR
Mostafa Dehghani, Alexey A. Gritsenko, Anurag Arnab, Matthias Minderer, Yi Tay
2021 J jnl
Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers.
CoRR
Yi Tay, Mostafa Dehghani, Jinfeng Rao, William Fedus, Samira Abnar, Hyung Won Chung, Sharan Narang, Dani Yogatama, Ashish Vaswani, Donald Metzler
2021 A* conf
Self-Instantiated Recurrent Units with Dynamic Soft Recursion.
NeurIPS
Aston Zhang, Yi Tay, Yikang Shen, Alvin Chan, Shuai Zhang
2021 J jnl
Sharpness-Aware Minimization Improves Language Model Generalization.
CoRR
Dara Bahri, Hossein Mobahi, Yi Tay
2021 — conf
StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling.
ACL/IJCNLP (1)
Yikang Shen, Yi Tay, Che Zheng, Dara Bahri, Donald Metzler, Aaron C. Courville
2021 J jnl
Switch Spaces: Learning Product Spaces with Sparse Gating.
CoRR
Shuai Zhang, Yi Tay, Wenqi Jiang, Da-Cheng Juan, Ce Zhang
2021 A* conf
Synthesizer: Rethinking Self-Attention for Transformer Models.
ICML
Yi Tay, Dara Bahri, Donald Metzler, Da-Cheng Juan, Zhe Zhao, Che Zheng
2021 J jnl
The Benchmark Lottery.
CoRR
Mostafa Dehghani, Yi Tay, Alexey A. Gritsenko, Zhe Zhao, Neil Houlsby, Fernando Diaz, Donald Metzler, Oriol Vinyals
2021 J jnl
The Efficiency Misnomer.
CoRR
Mostafa Dehghani, Anurag Arnab, Lucas Beyer, Ashish Vaswani, Yi Tay
2020 J jnl
Choppy: Cut Transformer For Ranked List Truncation.
CoRR
Dara Bahri, Yi Tay, Che Zheng, Donald Metzler, Andrew Tomkins
2020 A* conf
Choppy: Cut Transformer for Ranked List Truncation.
SIGIR
Dara Bahri, Yi Tay, Che Zheng, Donald Metzler, Andrew Tomkins
2020 J jnl
Efficient Transformers: A Survey.
CoRR
Yi Tay, Mostafa Dehghani, Dara Bahri, Donald Metzler
2020 J jnl
Generative Models are Unsupervised Predictors of Page Quality: A Colossal-Scale Study.
CoRR
Dara Bahri, Yi Tay, Che Zheng, Donald Metzler, Cliff Brunk, Andrew Tomkins
2020 J jnl
Holistic Multi-Modal Memory Network for Movie Question Answering.
IEEE Trans. Image Process.
Anran Wang, Anh Tuan Luu, Chuan-Sheng Foo, Hongyuan Zhu, Yi Tay, Vijay Chandrasekhar
2020 J jnl
HyperGrid: Efficient Multi-Task Transformers with Grid-wise Decomposable Hyper Projections.
CoRR
Yi Tay, Zhe Zhao, Dara Bahri, Donald Metzler, Da-Cheng Juan
2020 A conf
HyperML: A Boosting Metric Learning Approach in Hyperbolic Space for Recommender Systems.
WSDM
Lucas Vinh Tran, Yi Tay, Shuai Zhang, Gao Cong, Xiaoli Li
2020 A* conf
Interactive Machine Comprehension with Information Seeking Agents.
ACL
Xingdi Yuan, Jie Fu, Marc-Alexandre Côté, Yi Tay, Chris Pal, Adam Trischler
2020 A* conf
Jacobian Adversarially Regularized Networks for Robustness.
ICLR
Alvin Chan, Yi Tay, Yew-Soon Ong, Jie Fu
2020 J jnl
Long Range Arena: A Benchmark for Efficient Transformers.
CoRR
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler
2020 A* conf
Multi-Level Head-Wise Match and Aggregation in Transformer for Textual Sequence Matching.
AAAI
Shuohang Wang, Yunshi Lan, Yi Tay, Jing Jiang, Jingjing Liu
2020 J jnl
Multi-level Head-wise Match and Aggregation in Transformer for Textual Sequence Matching.
CoRR
Shuohang Wang, Yunshi Lan, Yi Tay, Jing Jiang, Jingjing Liu
2020 — conf
Poison Attacks against Text Datasets with Conditional Adversarially Regularized Autoencoder.
EMNLP (Findings)
Alvin Chan, Yi Tay, Yew-Soon Ong, Aston Zhang
2020 J jnl
Poison Attacks against Text Datasets with Conditional Adversarially Regularized Autoencoder.
CoRR
Alvin Chan, Yi Tay, Yew-Soon Ong, Aston Zhang
2020 A* conf
Reverse Engineering Configurations of Neural Text Generation Models.
ACL
Yi Tay, Dara Bahri, Che Zheng, Clifford Brunk, Donald Metzler, Andrew Tomkins
2020 J jnl
Reverse Engineering Configurations of Neural Text Generation Models.
CoRR
Yi Tay, Dara Bahri, Che Zheng, Clifford Brunk, Donald Metzler, Andrew Tomkins
2020 A* conf
Sparse Sinkhorn Attention.
ICML
Yi Tay, Dara Bahri, Liu Yang, Donald Metzler, Da-Cheng Juan
2020 J jnl
Sparse Sinkhorn Attention.
CoRR
Yi Tay, Dara Bahri, Liu Yang, Donald Metzler, Da-Cheng Juan
2020 J jnl
StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling.
CoRR
Yikang Shen, Yi Tay, Che Zheng, Dara Bahri, Donald Metzler, Aaron C. Courville
2020 J jnl
Surprise: Result List Truncation via Extreme Value Theory.
CoRR
Dara Bahri, Che Zheng, Yi Tay, Donald Metzler, Andrew Tomkins
2020 J jnl
Synthesizer: Rethinking Self-Attention in Transformer Models.
CoRR
Yi Tay, Dara Bahri, Donald Metzler, Da-Cheng Juan, Zhe Zhao, Che Zheng
2020 A* conf
What It Thinks Is Important Is Important: Robustness Transfers Through Input Gradients.
CVPR
Alvin Chan, Yi Tay, Yew-Soon Ong
2020 A* conf
Would you Rather? A New Benchmark for Learning Machine Alignment with Cultural Values and Social Preferences.
ACL
Yi Tay, Donovan Ong, Jie Fu, Alvin Chan, Nancy F. Chen, Anh Tuan Luu, Chris Pal
2019 — conf
Bridging the Gap between Relevance Matching and Semantic Matching for Short Text Similarity Modeling.
EMNLP/IJCNLP (1)
Jinfeng Rao, Linqing Liu, Yi Tay, Hsiu-Wei Yang, Peng Shi, Jimmy Lin
2019 A* conf
Compositional De-Attention Networks.
NeurIPS
Yi Tay, Anh Tuan Luu, Aston Zhang, Shuohang Wang, Siu Cheung Hui
2019 — conf
Confusionset-guided Pointer Networks for Chinese Spelling Check.
ACL (1)
Dingmin Wang, Yi Tay, Li Zhong
2019 J jnl
Deep Learning Based Recommender System: A Survey and New Perspectives.
ACM Comput. Surv.
Shuai Zhang, Lina Yao, Aixin Sun, Yi Tay
2019 A* conf
DeepRec: An Open-source Toolkit for Deep Learning based Recommendation.
IJCAI
Shuai Zhang, Yi Tay, Lina Yao, Bin Wu, Aixin Sun
2019 J jnl
DeepRec: An Open-source Toolkit for Deep Learning based Recommendation.
CoRR
Shuai Zhang, Yi Tay, Lina Yao, Bin Wu, Aixin Sun
2019 A* conf
Holographic Factorization Machines for Recommendation.
AAAI
Yi Tay, Shuai Zhang, Anh Tuan Luu, Siu Cheung Hui, Lina Yao, Tran Dang Quang Vinh
2019 A* conf
Interact and Decide: Medley of Sub-Attention Networks for Effective Group Recommendation.
SIGIR
Lucas Vinh Tran, Tuan-Anh Nguyen Pham, Yi Tay, Yiding Liu, Gao Cong, Xiaoli Li
2019 J jnl
Interactive Machine Comprehension with Information Seeking Agents.
CoRR
Xingdi Yuan, Jie Fu, Marc-Alexandre Côté, Yi Tay, Christopher J. Pal, Adam Trischler
2019 J jnl
Jacobian Adversarially Regularized Networks for Robustness.
CoRR
Alvin Chan, Yi Tay, Yew-Soon Ong, Jie Fu
2019 — conf
Lightweight and Efficient Neural Natural Language Processing with Quaternion Networks.
ACL (1)
Yi Tay, Aston Zhang, Anh Tuan Luu, Jinfeng Rao, Shuai Zhang, Shuohang Wang, Jie Fu, Siu Cheung Hui
2019 J jnl
Lightweight and Efficient Neural Natural Language Processing with Quaternion Networks.
CoRR
Yi Tay, Aston Zhang, Luu Anh Tuan, Jinfeng Rao, Shuai Zhang, Shuohang Wang, Jie Fu, Siu Cheung Hui
2019 — —
Neural architectures for natural language understanding
Yi Tay
2019 J jnl
Pair-Linking for Collective Entity Disambiguation: Two Could Be Better Than All.
IEEE Trans. Knowl. Data Eng.
Minh C. Phan, Aixin Sun, Yi Tay, Jialong Han, Chenliang Li
2019 A* conf
Quaternion Collaborative Filtering for Recommendation.
IJCAI
Shuai Zhang, Lina Yao, Lucas Vinh Tran, Aston Zhang, Yi Tay
2019 J jnl
Quaternion Collaborative Filtering for Recommendation.
CoRR
Shuai Zhang, Lina Yao, Lucas Vinh Tran, Aston Zhang, Yi Tay
2019 J jnl
Quaternion Knowledge Graph Embedding.
CoRR
Shuai Zhang, Yi Tay, Lina Yao, Qi Liu
2019 A* conf
Quaternion Knowledge Graph Embeddings.
NeurIPS
Shuai Zhang, Yi Tay, Lina Yao, Qi Liu
2019 — conf
Robust Representation Learning of Biomedical Names.
ACL (1)
Minh C. Phan, Aixin Sun, Yi Tay
2019 — conf
Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narratives.
ACL (1)
Yi Tay, Shuohang Wang, Anh Tuan Luu, Jie Fu, Minh C. Phan, Xingdi Yuan, Jinfeng Rao, Siu Cheung Hui, Aston Zhang
2019 J jnl
Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narratives.
CoRR
Yi Tay, Shuohang Wang, Luu Anh Tuan, Jie Fu, Minh C. Phan, Xingdi Yuan, Jinfeng Rao, Siu Cheung Hui, Aston Zhang
2019 J jnl
What it Thinks is Important is Important: Robustness Transfers through Input Gradients.
CoRR
Alvin Chan, Yi Tay, Yew-Soon Ong
2018 J jnl
A Compare-Propagate Architecture with Alignment Factorization for Natural Language Inference.
CoRR
Yi Tay, Luu Anh Tuan, Siu Cheung Hui
2018 A* conf
Attentive Gated Lexicon Reader with Contrastive Contextual Co-Attention for Sentiment Classification.
EMNLP
Yi Tay, Anh Tuan Luu, Siu Cheung Hui, Jian Su
2018 A* conf
Co-Stack Residual Affinity Networks with Multi-level Attention Refinement for Matching Text Sequences.
EMNLP
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
2018 J jnl
Co-Stack Residual Affinity Networks with Multi-level Attention Refinement for Matching Text Sequences.
CoRR
Yi Tay, Luu Anh Tuan, Siu Cheung Hui
2018 A* conf
Compare, Compress and Propagate: Enhancing Neural Architectures with Alignment Factorization for Natural Language Inference.
EMNLP
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
2018 A conf
CoupleNet: Paying Attention to Couples with Coupled Attention for Relationship Recommendation.
ICWSM
Yi Tay, Luu Anh Tuan, Siu Cheung Hui
2018 J jnl
CoupleNet: Paying Attention to Couples with Coupled Attention for Relationship Recommendation.
CoRR
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
2018 A* conf
Cross Temporal Recurrent Networks for Ranking Question Answer Pairs.
AAAI
Yi Tay, Luu Anh Tuan, Siu Cheung Hui
2018 A* conf
Densely Connected Attention Propagation for Reading Comprehension.
NeurIPS
Yi Tay, Anh Tuan Luu, Siu Cheung Hui, Jian Su
2018 J jnl
Densely Connected Attention Propagation for Reading Comprehension.
CoRR
Yi Tay, Luu Anh Tuan, Siu Cheung Hui, Jian Su
2018 A* conf
Hermitian Co-Attention Networks for Text Matching in Asymmetrical Domains.
IJCAI
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
2018 J jnl
Holistic Multi-modal Memory Network for Movie Question Answering.
CoRR
Anran Wang, Anh Tuan Luu, Chuan-Sheng Foo, Hongyuan Zhu, Yi Tay, Vijay Chandrasekhar
2018 J jnl
Hyperbolic Recommender Systems.
CoRR
Tran Dang Quang Vinh, Yi Tay, Shuai Zhang, Gao Cong, Xiao-Li Li
2018 A conf
Hyperbolic Representation Learning for Fast and Efficient Neural Question Answering.
WSDM
Yi Tay, Luu Anh Tuan, Siu Cheung Hui
2018 A* conf
Latent Relational Metric Learning via Memory-based Attention for Collaborative Ranking.
WWW
Yi Tay, Luu Anh Tuan, Siu Cheung Hui
2018 A* conf
Learning to Attend via Word-Aspect Associative Fusion for Aspect-Based Sentiment Analysis.
AAAI
Yi Tay, Luu Anh Tuan, Siu Cheung Hui
2018 J jnl
Multi-Cast Attention Networks for Retrieval-based Question Answering and Response Prediction.
CoRR
Yi Tay, Luu Anh Tuan, Siu Cheung Hui
2018 A* conf
Multi-Cast Attention Networks.
KDD
Yi Tay, Luu Anh Tuan, Siu Cheung Hui
2018 A* conf
Multi-Granular Sequence Encoding via Dilated Compositional Units for Reading Comprehension.
EMNLP
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
2018 A* conf
Multi-Pointer Co-Attention Networks for Recommendation.
KDD
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
2018 J jnl
Multi-Pointer Co-Attention Networks for Recommendation.
CoRR
Yi Tay, Luu Anh Tuan, Siu Cheung Hui
2018 J jnl
Multi-range Reasoning for Machine Comprehension.
CoRR
Yi Tay, Luu Anh Tuan, Siu Cheung Hui
2018 J jnl
Next Item Recommendation with Self-Attention.
CoRR
Shuai Zhang, Yi Tay, Lina Yao, Aixin Sun
2018 J jnl
Pair-Linking for Collective Entity Disambiguation: Two Could Be Better Than All.
CoRR
Minh C. Phan, Aixin Sun, Yi Tay, Jialong Han, Chenliang Li
2018 — conf
Reasoning with Sarcasm by Reading In-Between.
ACL (1)
Yi Tay, Anh Tuan Luu, Siu Cheung Hui, Jian Su
2018 J jnl
Reasoning with Sarcasm by Reading In-between.
CoRR
Yi Tay, Luu Anh Tuan, Siu Cheung Hui, Jian Su
2018 A* conf
Recurrently Controlled Recurrent Networks.
NeurIPS
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
2018 J jnl
Recurrently Controlled Recurrent Networks.
CoRR
Yi Tay, Luu Anh Tuan, Siu Cheung Hui
2018 A* conf
SkipFlow: Incorporating Neural Coherence Features for End-to-End Automatic Text Scoring.
AAAI
Yi Tay, Minh C. Phan, Luu Anh Tuan, Siu Cheung Hui
2017 J jnl
Cross Temporal Recurrent Networks for Ranking Question Answer Pairs.
CoRR
Yi Tay, Luu Anh Tuan, Siu Cheung Hui
2017 A* conf
Cross-Device User Linking: URL, Session, Visiting Time, and Device-log Embedding.
SIGIR
Minh C. Phan, Aixin Sun, Yi Tay
2017 A conf
Dyadic Memory Networks for Aspect-based Sentiment Analysis.
CIKM
Yi Tay, Luu Anh Tuan, Siu Cheung Hui
2017 J jnl
Enabling Efficient Question Answer Retrieval via Hyperbolic Neural Networks.
CoRR
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
2017 J jnl
Learning to Attend via Word-Aspect Associative Fusion for Aspect-based Sentiment Analysis.
CoRR
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
2017 A* conf
Learning to Rank Question Answer Pairs with Holographic Dual LSTM Architecture.
SIGIR
Yi Tay, Minh C. Phan, Anh Tuan Luu, Siu Cheung Hui
2017 J jnl
Learning to Rank Question Answer Pairs with Holographic Dual LSTM Architecture.
CoRR
Yi Tay, Cong-Minh Phan, Anh Tuan Luu, Siu Cheung Hui
2017 A conf
Multi-Task Neural Network for Non-discrete Attribute Prediction in Knowledge Graphs.
CIKM
Yi Tay, Luu Anh Tuan, Minh C. Phan, Siu Cheung Hui
2017 J jnl
Multi-task Neural Network for Non-discrete Attribute Prediction in Knowledge Graphs.
CoRR
Yi Tay, Anh Tuan Luu, Minh C. Phan, Siu Cheung Hui
2017 A conf
NeuPL: Attention-based Semantic Matching and Pair-Linking for Entity Disambiguation.
CIKM
Minh C. Phan, Aixin Sun, Yi Tay, Jialong Han, Chenliang Li
2017 A* conf
Non-Parametric Estimation of Multiple Embeddings for Link Prediction on Dynamic Knowledge Graphs.
AAAI
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
2017 A conf
Random Semantic Tensor Ensemble for Scalable Knowledge Graph Link Prediction.
WSDM
Yi Tay, Anh Tuan Luu, Siu Cheung Hui, Falk Brauer
2017 J jnl
SkipFlow: Incorporating Neural Coherence Features for End-to-End Automatic Text Scoring.
CoRR
Yi Tay, Minh C. Phan, Luu Anh Tuan, Siu Cheung Hui
2017 J jnl
Translational Recommender Networks.
CoRR
Yi Tay, Anh Tuan Luu, Siu Cheung Hui
2016 J jnl
Cross Device Matching for Online Advertising with Neural Feature Ensembles : First Place Solution at CIKM Cup 2016.
CoRR
Yi Tay, Cong-Minh Phan, Tuan-Anh Nguyen Pham
2016 A* conf
Learning Term Embeddings for Taxonomic Relation Identification Using Dynamic Weighting Neural Network.
EMNLP
Anh Tuan Luu, Yi Tay, Siu Cheung Hui, See-Kiong Ng