Duygu Ataman

39 papers A* 1B 1C 1Journal 20Unranked 15
YearRankTypeTitle / Venue / Authors
2025 — conf
Beyond statistical significance: Quantifying uncertainty and statistical variability in multilingual and multitask NLP evaluation.
IJCNLP-AACL (long papers)
Jonne Sälevä, Duygu Ataman, Constantine Lignos
2025 — conf
Evaluating Morphological Compositional Generalization in Large Language Models.
NAACL (Long Papers)
Mete Ismayilzada, Defne Circi, Jonne Sälevä, Hale Sirin, Abdullatif Köksal, Bhuwan Dhingra, Antoine Bosselut, Duygu Ataman, Lonneke van der Plas
2025 J jnl
From tests to effect sizes: Quantifying uncertainty and statistical variability in multilingual and multitask NLP evaluation benchmarks.
CoRR
Jonne Sälevä, Duygu Ataman, Constantine Lignos
2025 J jnl
Machine Translation in the Era of Large Language Models:A Survey of Historical and Emerging Problems.
Inf.
Duygu Ataman, Alexandra Birch, Nizar Habash, Marcello Federico, Philipp Koehn, Kyunghyun Cho
2025 — conf
TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languages.
ACL (1)
Jafar Isbarov, Arofat Akhundjanova, Mammad Hajili, Kavsar Huseynova, Dmitry Gaynullin, Anar Rzayev, Osman Tursun, Aizirek Turdubaeva, Ilshat Saetov, Rinat Kharisov, Saule Belginova, Ariana Kenbayeva, Amina Alisheva, Abdullatif Köksal, Samir Rustamov, Duygu Ataman
2025 J jnl
TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languages.
CoRR
Jafar Isbarov, Arofat Akhundjanova, Mammad Hajili, Kavsar Huseynova, Dmitry Gaynullin, Anar Rzayev, Osman Tursun, Ilshat Saetov, Rinat Kharisov, Saule Belginova, Ariana Kenbayeva, Amina Alisheva, Aizirek Turdubaeva, Abdullatif Köksal, Samir Rustamov, Duygu Ataman
2025 J jnl
The Ouroboros of Benchmarking: Reasoning Evaluation in an Era of Saturation.
CoRR
Ibrahim Ethem Deveci, Duygu Ataman
2024 J jnl
Evaluating Morphological Compositional Generalization in Large Language Models.
CoRR
Mete Ismayilzada, Defne Circi, Jonne Sälevä, Hale Sirin, Abdullatif Köksal, Bhuwan Dhingra, Antoine Bosselut, Lonneke van der Plas, Duygu Ataman
2024 J jnl
Generalization Measures for Zero-Shot Cross-Lingual Transfer.
CoRR
Saksham Bassi, Duygu Ataman, Kyunghyun Cho
2023 — conf
Delving into Evaluation Metrics for Generation: A Thorough Assessment of How Metrics Generalize to Rephrasing Across Languages.
Eval4NLP
Yixuan Wang, Qingyan Chen, Duygu Ataman
2022 — conf
Logographic Information Aids Learning Better Representations for Natural Language Inference.
AACL/IJCNLP (Findings)
Zijian Jin, Duygu Ataman
2022 J jnl
Logographic Information Aids Learning Better Representations for Natural Language Inference.
CoRR
Zijian Jin, Duygu Ataman
2022 J jnl
Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets.
Trans. Assoc. Comput. Linguistics
Julia Kreutzer, Isaac Caswell, Lisa Wang, Ahsan Wahab, Daan van Esch, Nasanbayar Ulzii-Orshikh, Allahsera Tapo, Nishant Subramani, Artem Sokolov, Claytone Sikasote, Monang Setyawan, Supheakmungkol Sarin, Sokhar Samb, Benoît Sagot, Clara Rivera, Annette Rios, Isabel Papadimitriou, Salomey Osei, Pedro Javier Ortiz Suárez, Iroro Orife, Kelechi Ogueji, Andre Niyongabo Rubungo, Toan Q. Nguyen, Mathias Müller, André Müller, Shamsuddeen Hassan Muhammad, Nanda Muhammad, Ayanda Mnyakeni, Jamshidbek Mirzakhalov, Tapiwanashe Matangira, Colin Leong, Nze Lawson, Sneha Kudugunta, Yacine Jernite, Mathias Jenny, Orhan Firat, Bonaventure F. P. Dossou, Sakhile Dlamini, Nisansa de Silva, Sakine Çabuk Balli, Stella Biderman, Alessia Battisti, Ahmed Baruwa, Ankur Bapna, Pallavi Baljekar, Israel Abebe Azime, Ayodele Awokoya, Duygu Ataman, Orevaoghene Ahia, Oghenefego Ahia, Sweta Agrawal, Mofetoluwa Adeyemi
2022 — conf
Quantifying Synthesis and Fusion and their Impact on Machine Translation.
NAACL-HLT
Arturo Oncevay, Duygu Ataman, Niels van Berkel, Barry Haddow, Alexandra Birch, Johannes Bjerva
2022 J jnl
Quantifying Synthesis and Fusion and their Impact on Machine Translation.
CoRR
Arturo Oncevay, Duygu Ataman, Niels van Berkel, Barry Haddow, Alexandra Birch, Johannes Bjerva
2022 B conf
UniMorph 4.0: Universal Morphology.
LREC
Khuyagbaatar Batsuren, Omer Goldman, Salam Khalifa, Nizar Habash, Witold Kieras, Gábor Bella, Brian Leonard, Garrett Nicolai, Kyle Gorman, Yustinus Ghanggo Ate, Maria Ryskina, Sabrina J. Mielke, Elena Budianskaya, Charbel El-Khaissi, Tiago Pimentel, Michael Gasser, William Abbott Lane, Mohit Raj, Matt Coler, Jaime Rafael Montoya Samame, Delio Siticonatzi Camaiteri, Esaú Zumaeta Rojas, Didier López Francis, Arturo Oncevay, Juan López Bautista, Gema Celeste Silva Villegas, Lucas Torroba Hennigen, Adam Ek, David Guriel, Peter Dirix, Jean-Philippe Bernardy, Andrey Scherbakov, Aziyana Bayyr-ool, Antonios Anastasopoulos, Roberto Zariquiey, Karina Sheifer, Sofya Ganieva, Hilaria Cruz, Ritván Karahóga, Stella Markantonatou, George Pavlidis, Matvey Plugaryov, Elena Klyachko, Ali Salehi, Candy Angulo, Jatayu Baxi, Andrew Krizhanovsky, Natalia Krizhanovskaya, Elizabeth Salesky, Clara Vania, Sardana Ivanova, Jennifer C. White, Rowan Hall Maudslay, Josef Valvoda, Ran Zmigrod, Paula Czarnowska, Irene Nikkarinen, Aelita Salchak, Brijesh Bhatt, Christopher Straughn, Zoey Liu, Jonathan North Washington, Yuval Pinter, Duygu Ataman, Marcin Wolinski, Totok Suhardijanto, Anna Yablonskaya, Niklas Stoehr, Hossep Dolatian, Zahroh Nuriah, Shyam Ratan, Francis M. Tyers, Edoardo M. Ponti, Grant Aiton, Aryaman Arora, Richard J. Hatcher, Ritesh Kumar, Jeremiah Young, Daria Rodionova, Anastasia Yemelina, Taras Andrushko, Igor Marchenko, Polina Mashkovtseva, Alexandra Serova, Emily Prud'hommeaux, Maria Nepomniashchaya, Fausto Giunchiglia, Eleanor Chodroff, Mans Hulden, Miikka Silfverberg, Arya D. McCarthy, David Yarowsky, Ryan Cotterell, Reut Tsarfaty, Ekaterina Vylomova
2022 J jnl
UniMorph 4.0: Universal Morphology.
CoRR
Khuyagbaatar Batsuren, Omer Goldman, Salam Khalifa, Nizar Habash, Witold Kieras, Gábor Bella, Brian Leonard, Garrett Nicolai, Kyle Gorman, Yustinus Ghanggo Ate, Maria Ryskina, Sabrina J. Mielke, Elena Budianskaya, Charbel El-Khaissi, Tiago Pimentel, Michael Gasser, William Lane, Mohit Raj, Matt Coler, Jaime Rafael Montoya Samame, Delio Siticonatzi Camaiteri, Esaú Zumaeta Rojas, Didier López Francis, Arturo Oncevay, Juan López Bautista, Gema Celeste Silva Villegas, Lucas Torroba Hennigen, Adam Ek, David Guriel, Peter Dirix, Jean-Philippe Bernardy, Andrey Scherbakov, Aziyana Bayyr-ool, Antonios Anastasopoulos, Roberto Zariquiey, Karina Sheifer, Sofya Ganieva, Hilaria Cruz, Ritván Karahóga, Stella Markantonatou, George Pavlidis, Matvey Plugaryov, Elena Klyachko, Ali Salehi, Candy Angulo, Jatayu Baxi, Andrew Krizhanovsky, Natalia Krizhanovskaya, Elizabeth Salesky, Clara Vania, Sardana Ivanova, Jennifer C. White, Rowan Hall Maudslay, Josef Valvoda, Ran Zmigrod, Paula Czarnowska, Irene Nikkarinen, Aelita Salchak, Brijesh Bhatt, Christopher Straughn, Zoey Liu, Jonathan North Washington, Yuval Pinter, Duygu Ataman, Marcin Wolinski, Totok Suhardijanto, Anna Yablonskaya, Niklas Stoehr, Hossep Dolatian, Zahroh Nuriah, Shyam Ratan, Francis M. Tyers, Edoardo M. Ponti, Grant Aiton, Aryaman Arora, Richard J. Hatcher, Ritesh Kumar, Jeremiah Young, Daria Rodionova, Anastasia Yemelina, Taras Andrushko, Igor Marchenko, Polina Mashkovtseva, Alexandra Serova, Emily Prud'hommeaux, Maria Nepomniashchaya, Fausto Giunchiglia, Eleanor Chodroff, Mans Hulden, Miikka Silfverberg, Arya D. McCarthy, David Yarowsky, Ryan Cotterell, Reut Tsarfaty, Ekaterina Vylomova
2021 — conf
A Large-Scale Study of Machine Translation in Turkic Languages.
EMNLP (1)
Jamshidbek Mirzakhalov, Anoop Babu, Duygu Ataman, Sherzod Kariev, Francis M. Tyers, Otabek Abduraufov, Mammad Hajili, Sardana Ivanova, Abror Khaytbaev, Antonio Laverghetta Jr., Behzodbek Moydinboyev, Esra Onal, Shaxnoza Pulatova, Ahsan Wahab, Orhan Firat, Sriram Chellappan
2021 J jnl
A Large-Scale Study of Machine Translation in the Turkic Languages.
CoRR
Jamshidbek Mirzakhalov, Anoop Babu, Duygu Ataman, Sherzod Kariev, Francis M. Tyers, Otabek Abduraufov, Mammad Hajili, Sardana Ivanova, Abror Khaytbaev, Antonio Laverghetta Jr., Behzodbek Moydinboyev, Esra Onal, Shaxnoza Pulatova, Ahsan Wahab, Orhan Firat, Sriram Chellappan
2021 — conf
Evaluating Multiway Multilingual NMT in the Turkic Languages.
WMT@EMNLP
Jamshidbek Mirzakhalov, Anoop Babu, Aigiz Kunafin, Ahsan Wahab, Behzodbek Moydinboyev, Sardana Ivanova, Mokhiyakhon Uzokova, Shaxnoza Pulatova, Duygu Ataman, Julia Kreutzer, Francis M. Tyers, Orhan Firat, John Licato, Sriram Chellappan
2021 J jnl
Evaluating Multiway Multilingual NMT in the Turkic Languages.
CoRR
Jamshidbek Mirzakhalov, Anoop Babu, Aigiz Kunafin, Ahsan Wahab, Behzod Moydinboyev, Sardana Ivanova, Mokhiyakhon Uzokova, Shaxnoza Pulatova, Duygu Ataman, Julia Kreutzer, Francis M. Tyers, Orhan Firat, John Licato, Sriram Chellappan
2021 — conf
Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets.
AfricaNLP
Isaac Caswell, Julia Kreutzer, Lisa Wang, Ahsan Wahab, Daan van Esch, Nasanbayar Ulzii-Orshikh, Allahsera Tapo, Nishant Subramani, Artem Sokolov, Claytone Sikasote, Monang Setyawan, Supheakmungkol Sarin, Sokhar Samb, Benoît Sagot, Clara Rivera, Annette Rios, Isabel Papadimitriou, Salomey Osei, Pedro Javier Ortiz Suárez, Iroro Orife, Kelechi Ogueji, Rubungo Andre Niyongabo, Toan Q. Nguyen, Mathias Müller, André Müller, Shamsuddeen Hassan Muhammad, Nanda Muhammad, Ayanda Mnyakeni, Jamshidbek Mirzakhalov, Tapiwanashe Matangira, Colin Leong, Nze Lawson, Sneha Kudugunta, Yacine Jernite, Mathias Jenny, Orhan Firat, Bonaventure F. P. Dossou, Sakhile Dlamini, Nisansa de Silva, Sakine Çabuk Balli, Stella Biderman, Alessia Battisti, Ahmed Baruwa, Ankur Bapna, Pallavi Baljekar, Israel Abebe Azime, Ayodele Awokoya, Duygu Ataman, Orevaoghene Ahia, Oghenefego Ahia, Sweta Agrawal, Mofetoluwa Adeyemi
2021 — conf
Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models.
EMNLP (1)
Jiaoda Li, Duygu Ataman, Rico Sennrich
2021 J jnl
Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models.
CoRR
Jiaoda Li, Duygu Ataman, Rico Sennrich
2020 A* conf
A Latent Morphology Model for Open-Vocabulary Neural Machine Translation.
ICLR
Duygu Ataman, Wilker Aziz, Alexandra Birch
2019 J jnl
A Latent Morphology Model for Open-Vocabulary Neural Machine Translation.
CoRR
Duygu Ataman, Wilker Aziz, Alexandra Birch
2019 — —
Learning Morphology for Open-Vocabulary Neural Machine Translation.
Duygu Ataman
2019 — conf
On the Importance of Word Boundaries in Character-level Neural Machine Translation.
NGT@EMNLP-IJCNLP
Duygu Ataman, Orhan Firat, Mattia Antonino Di Gangi, Marcello Federico, Alexandra Birch
2019 J jnl
On the Importance of Word Boundaries in Character-level Neural Machine Translation.
CoRR
Duygu Ataman, Orhan Firat, Mattia Antonino Di Gangi, Marcello Federico, Alexandra Birch
2018 — conf
An Evaluation of Two Vocabulary Reduction Methods for Neural Machine Translation.
AMTA (1)
Duygu Ataman, Marcello Federico
2018 J jnl
Bianet: A Parallel News Corpus in Turkish, Kurdish and English.
CoRR
Duygu Ataman
2018 — conf
Compositional Representation of Morphologically-Rich Input for Neural Machine Translation.
ACL (2)
Duygu Ataman, Marcello Federico
2018 J jnl
Compositional Representation of Morphologically-Rich Input for Neural Machine Translation.
CoRR
Duygu Ataman, Marcello Federico
2018 C conf
Compositional Source Word Representations for Neural Machine Translation.
EAMT
Duygu Ataman, Mattia Antonino Di Gangi, Marcello Federico
2017 J jnl
Automatic translation memory cleaning.
Mach. Transl.
Matteo Negri, Duygu Ataman, Masoud Jalili Sabet, Marco Turchi, Marcello Federico
2017 J jnl
Linguistically Motivated Vocabulary Reduction for Neural Machine Translation from Turkish to English.
CoRR
Duygu Ataman, Matteo Negri, Marco Turchi, Marcello Federico
2017 J jnl
Linguistically Motivated Vocabulary Reduction for Neural Machine Translation from Turkish to English.
Prague Bull. Math. Linguistics
Duygu Ataman, Matteo Negri, Marco Turchi, Marcello Federico
2016 — conf
FBK HLT-MT at SemEval-2016 Task 1: Cross-lingual Semantic Similarity Measurement Using Quality Estimation Features and Compositional Bilingual Word Embeddings.
SemEval@NAACL-HLT
Duygu Ataman, José Guilherme Camargo de Souza, Marco Turchi, Matteo Negri
2016 — conf
FBK's Neural Machine Translation Systems for IWSLT 2016.
IWSLT
M. Amin Farajian, Rajen Chatterjee, Costanza Conforti, Shahab Jalalvand, Vevake Balaraman, Mattia Antonino Di Gangi, Duygu Ataman, Marco Turchi, Matteo Negri, Marcello Federico