Adhiguna Kuncoro

34 papers A* 3Journal 20Unranked 11
YearRankTypeTitle / Venue / Authors
2024 J jnl
DiPaCo: Distributed Path Composition.
CoRR
Arthur Douillard, Qixuan Feng, Andrei A. Rusu, Adhiguna Kuncoro, Yani Donchev, Rachita Chhaparia, Ionel Gog, Marc'Aurelio Ranzato, Jiajun Shen, Arthur Szlam
2023 — conf
A Natural Bias for Language Generation Models.
ACL (2)
Clara Meister, Wojciech Stokowiec, Tiago Pimentel, Lei Yu, Laura Rimell, Adhiguna Kuncoro
2023 J jnl
DiLoCo: Distributed Low-Communication Training of Language Models.
CoRR
Arthur Douillard, Qixuang Feng, Andrei A. Rusu, Rachita Chhaparia, Yani Donchev, Adhiguna Kuncoro, Marc'Aurelio Ranzato, Arthur Szlam, Jiajun Shen
2023 — conf
On "Scientific Debt" in NLP: A Case for More Rigour in Language Model Pre-Training Research.
ACL (1)
Made Nindyatama Nityasya, Haryo Akbarianto Wibowo, Alham Fikri Aji, Genta Indra Winata, Radityo Eko Prasojo, Phil Blunsom, Adhiguna Kuncoro
2023 J jnl
On "Scientific Debt" in NLP: A Case for More Rigour in Language Model Pre-Training Research.
CoRR
Made Nindyatama Nityasya, Haryo Akbarianto Wibowo, Alham Fikri Aji, Genta Indra Winata, Radityo Eko Prasojo, Phil Blunsom, Adhiguna Kuncoro
2022 J jnl
A Natural Bias for Language Generation Models.
CoRR
Clara Meister, Wojciech Stokowiec, Tiago Pimentel, Lei Yu, Laura Rimell, Adhiguna Kuncoro
2022 A* conf
A Systematic Investigation of Commonsense Knowledge in Large Language Models.
EMNLP
Xiang Lorraine Li, Adhiguna Kuncoro, Jordan Hoffmann, Cyprien de Masson d'Autume, Phil Blunsom, Aida Nematzadeh
2022 J jnl
Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale.
CoRR
Laurent Sartran, Samuel Barrett, Adhiguna Kuncoro, Milos Stanojevic, Phil Blunsom, Chris Dyer
2022 J jnl
Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale.
Trans. Assoc. Comput. Linguistics
Laurent Sartran, Samuel Barrett, Adhiguna Kuncoro, Milos Stanojevic, Phil Blunsom, Chris Dyer
2021 J jnl
A Systematic Investigation of Commonsense Understanding in Large Language Models.
CoRR
Xiang Lorraine Li, Adhiguna Kuncoro, Cyprien de Masson d'Autume, Phil Blunsom, Aida Nematzadeh
2021 — conf
IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation.
EMNLP (1)
Samuel Cahyawijaya, Genta Indra Winata, Bryan Wilie, Karissa Vincentio, Xiaohong Li, Adhiguna Kuncoro, Sebastian Ruder, Zhi Yuan Lim, Syafri Bahar, Masayu Leylia Khodra, Ayu Purwarianti, Pascale Fung
2021 J jnl
IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation.
CoRR
Samuel Cahyawijaya, Genta Indra Winata, Bryan Wilie, Karissa Vincentio, Xiaohong Li, Adhiguna Kuncoro, Sebastian Ruder, Zhi Yuan Lim, Syafri Bahar, Masayu Leylia Khodra, Ayu Purwarianti, Pascale Fung
2021 A* conf
Mind the Gap: Assessing Temporal Generalization in Neural Language Models.
NeurIPS
Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Tomás Kociský, Sebastian Ruder, Dani Yogatama, Kris Cao, Susannah Young, Phil Blunsom
2021 J jnl
Pitfalls of Static Language Modelling.
CoRR
Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Sebastian Ruder, Dani Yogatama, Kris Cao, Tomás Kociský, Susannah Young, Phil Blunsom
2021 J jnl
Scaling Language Models: Methods, Analysis & Insights from Training Gopher.
CoRR
Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, H. Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-Sen Huang, Amelia Glaese, Johannes Welbl, Sumanth Dathathri, Saffron Huang, Jonathan Uesato, John Mellor, Irina Higgins, Antonia Creswell, Nat McAleese, Amy Wu, Erich Elsen, Siddhant M. Jayakumar, Elena Buchatskaya, David Budden, Esme Sutherland, Karen Simonyan, Michela Paganini, Laurent Sifre, Lena Martens, Xiang Lorraine Li, Adhiguna Kuncoro, Aida Nematzadeh, Elena Gribovskaya, Domenic Donato, Angeliki Lazaridou, Arthur Mensch, Jean-Baptiste Lespiau, Maria Tsimpoukelli, Nikolai Grigorev, Doug Fritz, Thibault Sottiaux, Mantas Pajarskas, Toby Pohlen, Zhitao Gong, Daniel Toyama, Cyprien de Masson d'Autume, Yujia Li, Tayfun Terzi, Vladimir Mikulik, Igor Babuschkin, Aidan Clark, Diego de Las Casas, Aurelia Guy, Chris Jones, James Bradbury, Matthew J. Johnson, Blake A. Hechtman, Laura Weidinger, Iason Gabriel, William Isaac, Edward Lockhart, Simon Osindero, Laura Rimell, Chris Dyer, Oriol Vinyals, Kareem Ayoub, Jeff Stanway, Lorrayne Bennett, Demis Hassabis, Koray Kavukcuoglu, Geoffrey Irving
2020 J jnl
Syntactic Structure Distillation Pretraining For Bidirectional Encoders.
CoRR
Adhiguna Kuncoro, Lingpeng Kong, Daniel Fried, Dani Yogatama, Laura Rimell, Chris Dyer, Phil Blunsom
2020 J jnl
Syntactic Structure Distillation Pretraining for Bidirectional Encoders.
Trans. Assoc. Comput. Linguistics
Adhiguna Kuncoro, Lingpeng Kong, Daniel Fried, Dani Yogatama, Laura Rimell, Chris Dyer, Phil Blunsom
2019 — conf
Scalable Syntax-Aware Language Models Using Knowledge Distillation.
ACL (1)
Adhiguna Kuncoro, Chris Dyer, Laura Rimell, Stephen Clark, Phil Blunsom
2019 J jnl
Scalable Syntax-Aware Language Models Using Knowledge Distillation.
CoRR
Adhiguna Kuncoro, Chris Dyer, Laura Rimell, Stephen Clark, Phil Blunsom
2019 — conf
Text Genre and Training Data Size in Human-like Parsing.
EMNLP/IJCNLP (1)
John T. Hale, Adhiguna Kuncoro, Keith Hall, Chris Dyer, Jonathan Brennan
2019 — conf
Unsupervised Recurrent Neural Network Grammars.
NAACL-HLT (1)
Yoon Kim, Alexander M. Rush, Lei Yu, Adhiguna Kuncoro, Chris Dyer, Gábor Melis
2019 J jnl
Unsupervised Recurrent Neural Network Grammars.
CoRR
Yoon Kim, Alexander M. Rush, Lei Yu, Adhiguna Kuncoro, Chris Dyer, Gábor Melis
2018 J jnl
Finding Syntax in Human Encephalography with Beam Search.
CoRR
John T. Hale, Chris Dyer, Adhiguna Kuncoro, Jonathan R. Brennan
2018 — conf
Finding syntax in human encephalography with beam search.
ACL (1)
John T. Hale, Chris Dyer, Adhiguna Kuncoro, Jonathan Brennan
2018 — conf
LSTMs Can Learn Syntax-Sensitive Dependencies Well, But Modeling Structure Makes Them Better.
ACL (1)
Adhiguna Kuncoro, Chris Dyer, John Hale, Dani Yogatama, Stephen Clark, Phil Blunsom
2018 — conf
Memory Architectures in Recurrent Neural Network Language Models.
ICLR (Poster)
Dani Yogatama, Yishu Miao, Gábor Melis, Wang Ling, Adhiguna Kuncoro, Chris Dyer, Phil Blunsom
2017 J jnl
DyNet: The Dynamic Neural Network Toolkit.
CoRR
Graham Neubig, Chris Dyer, Yoav Goldberg, Austin Matthews, Waleed Ammar, Antonios Anastasopoulos, Miguel Ballesteros, David Chiang, Daniel Clothiaux, Trevor Cohn, Kevin Duh, Manaal Faruqui, Cynthia Gan, Dan Garrette, Yangfeng Ji, Lingpeng Kong, Adhiguna Kuncoro, Gaurav Kumar, Chaitanya Malaviya, Paul Michel, Yusuke Oda, Matthew Richardson, Naomi Saphra, Swabha Swayamdipta, Pengcheng Yin
2017 — conf
What Do Recurrent Neural Network Grammars Learn About Syntax?
EACL (1)
Adhiguna Kuncoro, Miguel Ballesteros, Lingpeng Kong, Chris Dyer, Graham Neubig, Noah A. Smith
2016 J jnl
Dependency Parsing with LSTMs: An Empirical Evaluation.
CoRR
Adhiguna Kuncoro, Yuichiro Sawai, Kevin Duh, Yuji Matsumoto
2016 A* conf
Distilling an Ensemble of Greedy Dependency Parsers into One MST Parser.
EMNLP
Adhiguna Kuncoro, Miguel Ballesteros, Lingpeng Kong, Chris Dyer, Noah A. Smith
2016 J jnl
Distilling an Ensemble of Greedy Dependency Parsers into One MST Parser.
CoRR
Adhiguna Kuncoro, Miguel Ballesteros, Lingpeng Kong, Chris Dyer, Noah A. Smith
2016 — conf
Recurrent Neural Network Grammars.
HLT-NAACL
Chris Dyer, Adhiguna Kuncoro, Miguel Ballesteros, Noah A. Smith
2016 J jnl
Recurrent Neural Network Grammars.
CoRR
Chris Dyer, Adhiguna Kuncoro, Miguel Ballesteros, Noah A. Smith
2016 J jnl
What Do Recurrent Neural Network Grammars Learn About Syntax?
CoRR
Adhiguna Kuncoro, Miguel Ballesteros, Lingpeng Kong, Chris Dyer, Graham Neubig, Noah A. Smith