Ahmet Üstün

Publication Activity (10 Years)

Years Active: 2016-2024
Publications (10 Years): 43

Top Topics

Transfer Learning

Language Modeling

Morphological Segmentation

Source Language

Top Venues

Publications

Shivalika Singh, Freddie Vargus, Daniel D'souza, Börje Karlsson, Abinaya Mahendiran, Wei-Yin Ko, Herumb Shandilya, Jay Patel, Deividas Mataciunas, Laura O'Mahony, Mike Zhang, Ramith Hettiarachchi, Joseph Wilson, Marina Machado, Luisa Souza Moura, Dominik Krzeminski, Hakimeh Fadaei, Irem Ergün, Ifeoma Okoh, Aisha Alaagib, Oshan Mudannayake, Zaid Alyafeai, Minh Vu Chien, Sebastian Ruder, Surya Guthikonda, Emad A. Alghamdi, Sebastian Gehrmann, Niklas Muennighoff, Max Bartolo, Julia Kreutzer, Ahmet Üstün, Marzieh Fadaee, Sara Hooker
Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning. ACL (1) (2024)
Ahmet Üstün, Viraat Aryabumi, Zheng Xin Yong, Wei-Yin Ko, Daniel D'souza, Gbemileke Onilude, Neel Bhandari, Shivalika Singh, Hui-Lee Ooi, Amr Kayid, Freddie Vargus, Phil Blunsom, Shayne Longpre, Niklas Muennighoff, Marzieh Fadaee, Julia Kreutzer, Sara Hooker
Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model. CoRR (2024)
Arash Ahmadian, Chris Cremer, Matthias Gallé, Marzieh Fadaee, Julia Kreutzer, Olivier Pietquin, Ahmet Üstün, Sara Hooker
Back to Basics: Revisiting REINFORCE Style Optimization for Learning from Human Feedback in LLMs. CoRR (2024)
John Dang, Arash Ahmadian, Kelly Marchisio, Julia Kreutzer, Ahmet Üstün, Sara Hooker
RLHF Can Speak Many Languages: Unlocking Multilingual Preference Optimization for LLMs. CoRR (2024)
Viraat Aryabumi, John Dang, Dwarak Talupuru, Saurabh Dash, David Cairuz, Hangyu Lin, Bharat Venkitesh, Madeline Smith, Jon Ander Campos, Yi Chern Tan, Kelly Marchisio, Max Bartolo, Sebastian Ruder, Acyr Locatelli, Julia Kreutzer, Nick Frosst, Aidan N. Gomez, Phil Blunsom, Marzieh Fadaee, Ahmet Üstün, Sara Hooker
Aya 23: Open Weight Releases to Further Multilingual Progress. CoRR (2024)
Kelly Marchisio, Saurabh Dash, Hongyu Chen, Dennis Aumiller, Ahmet Üstün, Sara Hooker, Sebastian Ruder
How Does Quantization Affect Multilingual LLMs? CoRR (2024)
Arash Ahmadian, Chris Cremer, Matthias Gallé, Marzieh Fadaee, Julia Kreutzer, Olivier Pietquin, Ahmet Üstün, Sara Hooker
Back to Basics: Revisiting REINFORCE-Style Optimization for Learning from Human Feedback in LLMs. ACL (1) (2024)
Shivalika Singh, Freddie Vargus, Daniel D'souza, Börje F. Karlsson, Abinaya Mahendiran, Wei-Yin Ko, Herumb Shandilya, Jay Patel, Deividas Mataciunas, Laura O'Mahony, Mike Zhang, Ramith Hettiarachchi, Joseph Wilson, Marina Machado, Luisa Souza Moura, Dominik Krzeminski, Hakimeh Fadaei, Irem Ergün, Ifeoma Okoh, Aisha Alaagib, Oshan Mudannayake, Zaid Alyafeai, Minh Chien Vu, Sebastian Ruder, Surya Guthikonda, Emad A. Alghamdi, Sebastian Gehrmann, Niklas Muennighoff, Max Bartolo, Julia Kreutzer, Ahmet Üstün, Marzieh Fadaee, Sara Hooker
Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning. CoRR (2024)
Ted Zadouri, Ahmet Üstün, Arash Ahmadian, Beyza Ermis, Acyr Locatelli, Sara Hooker
Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning. ICLR (2024)
Arash Ahmadian, Saurabh Dash, Hongyu Chen, Bharat Venkitesh, Stephen Gou, Phil Blunsom, Ahmet Üstün, Sara Hooker
Intriguing Properties of Quantization at Scale. CoRR (2023)
Ted Zadouri, Ahmet Üstün, Arash Ahmadian, Beyza Ermis, Acyr Locatelli, Sara Hooker
Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning. CoRR (2023)
Arash Ahmadian, Saurabh Dash, Hongyu Chen, Bharat Venkitesh, Stephen Zhen Gou, Phil Blunsom, Ahmet Üstün, Sara Hooker
Intriguing Properties of Quantization at Scale. NeurIPS (2023)
Max Marion, Ahmet Üstün, Luiza Pozzobon, Alex Wang, Marzieh Fadaee, Sara Hooker
When Less is More: Investigating Data Pruning for Pretraining LLMs at Scale. CoRR (2023)
Ahmet Üstün, Asa Cooper Stickland
When does Parameter-Efficient Transfer Learning Work for Machine Translation? EMNLP (2022)
Ahmet Üstün, Asa Cooper Stickland
When does Parameter-Efficient Transfer Learning Work for Machine Translation? CoRR (2022)
Ahmet Üstün, Arianna Bisazza, Gosse Bouma, Gertjan van Noord
UDapter: Typology-based Language Adapters for Multilingual Dependency Parsing and Sequence Labeling. Comput. Linguistics 48 (3) (2022)
Ahmet Üstün, Arianna Bisazza, Gosse Bouma, Gertjan van Noord, Sebastian Ruder
Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer. EMNLP (2022)
Ahmet Üstün, Arianna Bisazza, Gosse Bouma, Gertjan van Noord, Sebastian Ruder
Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer. CoRR (2022)
Arianna Bisazza, Ahmet Üstün, Stephan Sportel
On the Difficulty of Translating Free-Order Case-Marking Languages. Trans. Assoc. Comput. Linguistics 9 (2021)
Arianna Bisazza, Ahmet Üstün, Stephan Sportel
On the Difficulty of Translating Free-Order Case-Marking Languages. CoRR (2021)
Rob van der Goot, Ahmet Üstün, Alan Ramponi, Ibrahim Sharaf, Barbara Plank
Massive Choice, Ample Tasks (MaChAmp): A Toolkit for Multi-task Learning in NLP. EACL (System Demonstrations) (2021)
Rob van der Goot, Ibrahim Sharaf, Aizhan Imankulova, Ahmet Üstün, Marija Stepanovic, Alan Ramponi, Siti Oryza Khairunnisa, Mamoru Komachi, Barbara Plank
From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding. NAACL-HLT (2021)
Masha Medvedeva, Ahmet Üstün, Xiao Xu, Michel Vols, Martijn Wieling
Automatic Judgement Forecasting for Pending Applications of the European Court of Human Rights. ASAIL/LegalAIIA@ICAIL (2021)
Ahmet Üstün, Burcu Can
Incorporating word embeddings in unsupervised morphological segmentation. Nat. Lang. Eng. 27 (5) (2021)
Ahmet Üstün, Alexandre Bérard, Laurent Besacier, Matthias Gallé
Multilingual Unsupervised Neural Machine Translation with Denoising Adapters. CoRR (2021)
Rob van der Goot, Ahmet Üstün, Barbara Plank
On the Effectiveness of Dataset Embeddings in Mono-lingual, Multi-lingual and Zero-shot Conditions. CoRR (2021)
Rob van der Goot, Ibrahim Sharaf, Aizhan Imankulova, Ahmet Üstün, Marija Stepanovic, Alan Ramponi, Siti Oryza Khairunnisa, Mamoru Komachi, Barbara Plank
From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding. CoRR (2021)
Lukas Edman, Ahmet Üstün, Antonio Toral, Gertjan van Noord
Unsupervised Translation of German-Lower Sorbian: Exploring Training and Novel Transfer Methods on a Low-Resource Language. WMT@EMNLP (2021)
Lukas Edman, Ahmet Üstün, Antonio Toral, Gertjan van Noord
Unsupervised Translation of German-Lower Sorbian: Exploring Training and Novel Transfer Methods on a Low-Resource Language. CoRR (2021)
Ahmet Üstün, Alexandre Berard, Laurent Besacier, Matthias Gallé
Multilingual Unsupervised Neural Machine Translation with Denoising Adapters. EMNLP (1) (2021)
Bertelt Braaksma, Richard Scholtens, Stan van Suijlekom, Remy Wang, Ahmet Üstün
FiSSA at SemEval-2020 Task 9: Fine-tuned for Feelings. SemEval@COLING (2020)
Ahmet Üstün, Arianna Bisazza, Gosse Bouma, Gertjan van Noord
UDapter: Language Adaptation for Truly Universal Dependency Parsing. EMNLP (1) (2020)
Rob van der Goot, Ahmet Üstün, Alan Ramponi, Barbara Plank
Massive Choice, Ample Tasks (MaChAmp): A Toolkit for Multi-task Learning in NLP. CoRR (2020)
Bertelt Braaksma, Richard Scholtens, Stan van Suijlekom, Remy Wang, Ahmet Üstün
FiSSA at SemEval-2020 Task 9: Fine-tuned For Feelings. CoRR (2020)
Ahmet Üstün, Arianna Bisazza, Gosse Bouma, Gertjan van Noord
UDapter: Language Adaptation for Truly Universal Dependency Parsing. CoRR (2020)
Ahmet Üstün, Gosse Bouma, Gertjan van Noord
Cross-Lingual Word Embeddings for Morphologically Rich Languages. RANLP (2019)
Tommaso Caselli, Ahmet Üstün
There and Back Again: Cross-Lingual Transfer Learning for Event Detection. CLiC-it (2019)
Ahmet Üstün, Murathan Kurfali, Burcu Can
Characters or Morphemes: How to Represent Words? Rep4NLP@ACL (2018)
Murathan Kurfali, Ahmet Üstün, Burcu Can
A Trie-structured Bayesian Model for Unsupervised Morphological Segmentation. CICLing (1) (2017)
Burcu Can, Ahmet Üstün, Murathan Kurfali
Turkish PoS Tagging by Reducing Sparsity with Morpheme Tags in Small Datasets. CoRR (2017)
Murathan Kurfali, Ahmet Üstün, Burcu Can
A Trie-Structured Bayesian Model for Unsupervised Morphological Segmentation. CoRR (2017)
Ahmet Üstün, Burcu Can
Unsupervised Morphological Segmentation Using Neural Word Embeddings. SLSP (2016)
Burcu Can, Ahmet Üstün, Murathan Kurfali
Turkish PoS Tagging by Reducing Sparsity with Morpheme Tags in Small Datasets. CICLing (1) (2016)