Adhiguna Kuncoro

Publication Activity (10 Years)

Years Active: 2016-2024
Publications (10 Years): 34

Top Topics

Language Models For Information Retrieval

Dependency Parser

Top Venues

Trans. Assoc. Comput. Linguistics

Publications

Arthur Douillard, Qixuan Feng, Andrei A. Rusu, Adhiguna Kuncoro, Yani Donchev, Rachita Chhaparia, Ionel Gog, Marc'Aurelio Ranzato, Jiajun Shen, Arthur Szlam
DiPaCo: Distributed Path Composition. CoRR (2024)
Clara Meister, Wojciech Stokowiec, Tiago Pimentel, Lei Yu, Laura Rimell, Adhiguna Kuncoro
A Natural Bias for Language Generation Models. ACL (2) (2023)
Made Nindyatama Nityasya, Haryo Akbarianto Wibowo, Alham Fikri Aji, Genta Indra Winata, Radityo Eko Prasojo, Phil Blunsom, Adhiguna Kuncoro
On "Scientific Debt" in NLP: A Case for More Rigour in Language Model Pre-Training Research. CoRR (2023)
Arthur Douillard, Qixuang Feng, Andrei A. Rusu, Rachita Chhaparia, Yani Donchev, Adhiguna Kuncoro, Marc'Aurelio Ranzato, Arthur Szlam, Jiajun Shen
DiLoCo: Distributed Low-Communication Training of Language Models. CoRR (2023)
Made Nindyatama Nityasya, Haryo Akbarianto Wibowo, Alham Fikri Aji, Genta Indra Winata, Radityo Eko Prasojo, Phil Blunsom, Adhiguna Kuncoro
On "Scientific Debt" in NLP: A Case for More Rigour in Language Model Pre-Training Research. ACL (1) (2023)
Clara Meister, Wojciech Stokowiec, Tiago Pimentel, Lei Yu, Laura Rimell, Adhiguna Kuncoro
A Natural Bias for Language Generation Models. CoRR (2022)
Xiang Lorraine Li, Adhiguna Kuncoro, Jordan Hoffmann, Cyprien de Masson d'Autume, Phil Blunsom, Aida Nematzadeh
A Systematic Investigation of Commonsense Knowledge in Large Language Models. EMNLP (2022)
Laurent Sartran, Samuel Barrett, Adhiguna Kuncoro, Milos Stanojevic, Phil Blunsom, Chris Dyer
Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale. Trans. Assoc. Comput. Linguistics 10 (2022)
Laurent Sartran, Samuel Barrett, Adhiguna Kuncoro, Milos Stanojevic, Phil Blunsom, Chris Dyer
Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale. CoRR (2022)
Samuel Cahyawijaya, Genta Indra Winata, Bryan Wilie, Karissa Vincentio, Xiaohong Li, Adhiguna Kuncoro, Sebastian Ruder, Zhi Yuan Lim, Syafri Bahar, Masayu Leylia Khodra, Ayu Purwarianti, Pascale Fung
IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation. CoRR (2021)
Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, H. Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-Sen Huang, Amelia Glaese, Johannes Welbl, Sumanth Dathathri, Saffron Huang, Jonathan Uesato, John Mellor, Irina Higgins, Antonia Creswell, Nat McAleese, Amy Wu, Erich Elsen, Siddhant M. Jayakumar, Elena Buchatskaya, David Budden, Esme Sutherland, Karen Simonyan, Michela Paganini, Laurent Sifre, Lena Martens, Xiang Lorraine Li, Adhiguna Kuncoro, Aida Nematzadeh, Elena Gribovskaya, Domenic Donato, Angeliki Lazaridou, Arthur Mensch, Jean-Baptiste Lespiau, Maria Tsimpoukelli, Nikolai Grigorev, Doug Fritz, Thibault Sottiaux, Mantas Pajarskas, Toby Pohlen, Zhitao Gong, Daniel Toyama, Cyprien de Masson d'Autume, Yujia Li, Tayfun Terzi, Vladimir Mikulik, Igor Babuschkin, Aidan Clark, Diego de Las Casas, Aurelia Guy, Chris Jones, James Bradbury, Matthew Johnson, Blake A. Hechtman, Laura Weidinger, Iason Gabriel, William S. Isaac, Edward Lockhart, Simon Osindero, Laura Rimell, Chris Dyer, Oriol Vinyals, Kareem Ayoub, Jeff Stanway, Lorrayne Bennett, Demis Hassabis, Koray Kavukcuoglu, Geoffrey Irving
Scaling Language Models: Methods, Analysis & Insights from Training Gopher. CoRR (2021)
Samuel Cahyawijaya, Genta Indra Winata, Bryan Wilie, Karissa Vincentio, Xiaohong Li, Adhiguna Kuncoro, Sebastian Ruder, Zhi Yuan Lim, Syafri Bahar, Masayu Leylia Khodra, Ayu Purwarianti, Pascale Fung
IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation. EMNLP (1) (2021)
Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Sebastian Ruder, Dani Yogatama, Kris Cao, Tomás Kociský, Susannah Young, Phil Blunsom
Pitfalls of Static Language Modelling. CoRR (2021)
Xiang Lorraine Li, Adhiguna Kuncoro, Cyprien de Masson d'Autume, Phil Blunsom, Aida Nematzadeh
A Systematic Investigation of Commonsense Understanding in Large Language Models. CoRR (2021)
Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Tomás Kociský, Sebastian Ruder, Dani Yogatama, Kris Cao, Susannah Young, Phil Blunsom
Mind the Gap: Assessing Temporal Generalization in Neural Language Models. NeurIPS (2021)
Adhiguna Kuncoro, Lingpeng Kong, Daniel Fried, Dani Yogatama, Laura Rimell, Chris Dyer, Phil Blunsom
Syntactic Structure Distillation Pretraining for Bidirectional Encoders. Trans. Assoc. Comput. Linguistics 8 (2020)
Adhiguna Kuncoro, Lingpeng Kong, Daniel Fried, Dani Yogatama, Laura Rimell, Chris Dyer, Phil Blunsom
Syntactic Structure Distillation Pretraining For Bidirectional Encoders. CoRR (2020)
Yoon Kim, Alexander M. Rush, Lei Yu, Adhiguna Kuncoro, Chris Dyer, Gábor Melis
Unsupervised Recurrent Neural Network Grammars. CoRR (2019)
Adhiguna Kuncoro, Chris Dyer, Laura Rimell, Stephen Clark, Phil Blunsom
Scalable Syntax-Aware Language Models Using Knowledge Distillation. CoRR (2019)
Yoon Kim, Alexander M. Rush, Lei Yu, Adhiguna Kuncoro, Chris Dyer, Gábor Melis
Unsupervised Recurrent Neural Network Grammars. NAACL-HLT (1) (2019)
Adhiguna Kuncoro, Chris Dyer, Laura Rimell, Stephen Clark, Phil Blunsom
Scalable Syntax-Aware Language Models Using Knowledge Distillation. ACL (1) (2019)
John B. Hale, Adhiguna Kuncoro, Keith Hall, Chris Dyer, Jonathan Brennan
Text Genre and Training Data Size in Human-like Parsing. EMNLP/IJCNLP (1) (2019)
John Hale, Chris Dyer, Adhiguna Kuncoro, Jonathan R. Brennan
Finding Syntax in Human Encephalography with Beam Search. CoRR (2018)
Dani Yogatama, Yishu Miao, Gábor Melis, Wang Ling, Adhiguna Kuncoro, Chris Dyer, Phil Blunsom
Memory Architectures in Recurrent Neural Network Language Models. ICLR (Poster) (2018)
Adhiguna Kuncoro, Chris Dyer, John Hale, Dani Yogatama, Stephen Clark, Phil Blunsom
LSTMs Can Learn Syntax-Sensitive Dependencies Well, But Modeling Structure Makes Them Better. ACL (1) (2018)
John Hale, Chris Dyer, Adhiguna Kuncoro, Jonathan Brennan
Finding syntax in human encephalography with beam search. ACL (1) (2018)
Graham Neubig, Chris Dyer, Yoav Goldberg, Austin Matthews, Waleed Ammar, Antonios Anastasopoulos, Miguel Ballesteros, David Chiang, Daniel Clothiaux, Trevor Cohn, Kevin Duh, Manaal Faruqui, Cynthia Gan, Dan Garrette, Yangfeng Ji, Lingpeng Kong, Adhiguna Kuncoro, Gaurav Kumar, Chaitanya Malaviya, Paul Michel, Yusuke Oda, Matthew Richardson, Naomi Saphra, Swabha Swayamdipta, Pengcheng Yin
DyNet: The Dynamic Neural Network Toolkit. CoRR (2017)
Adhiguna Kuncoro, Miguel Ballesteros, Lingpeng Kong, Chris Dyer, Graham Neubig, Noah A. Smith
What Do Recurrent Neural Network Grammars Learn About Syntax? EACL (1) (2017)
Adhiguna Kuncoro, Miguel Ballesteros, Lingpeng Kong, Chris Dyer, Graham Neubig, Noah A. Smith
What Do Recurrent Neural Network Grammars Learn About Syntax? CoRR (2016)
Chris Dyer, Adhiguna Kuncoro, Miguel Ballesteros, Noah A. Smith
Recurrent Neural Network Grammars. CoRR (2016)
Chris Dyer, Adhiguna Kuncoro, Miguel Ballesteros, Noah A. Smith
Recurrent Neural Network Grammars. HLT-NAACL (2016)
Adhiguna Kuncoro, Miguel Ballesteros, Lingpeng Kong, Chris Dyer, Noah A. Smith
Distilling an Ensemble of Greedy Dependency Parsers into One MST Parser. CoRR (2016)
Adhiguna Kuncoro, Yuichiro Sawai, Kevin Duh, Yuji Matsumoto
Dependency Parsing with LSTMs: An Empirical Evaluation. CoRR (2016)
Adhiguna Kuncoro, Miguel Ballesteros, Lingpeng Kong, Chris Dyer, Noah A. Smith
Distilling an Ensemble of Greedy Dependency Parsers into One MST Parser. EMNLP (2016)