Vivien Macketanz

27 papers B 2Journal 7Unranked 18

Year	Rank	Type	Title / Venue / Authors
2024	—	`conf`	Investigating the Linguistic Performance of Large Language Models in Machine Translation. WMT Shushen Manakhimova, Vivien Macketanz, Eleftherios Avramidis, Ekaterina Lapshinova-Koltunski, Sergei Bagdasarov, Sebastian Möller
2024	—	`conf`	Machine Translation Metrics Are Better in Evaluating Linguistic Errors on LLMs than on Encoder-Decoder Systems. WMT Eleftherios Avramidis, Shushen Manakhimova, Vivien Macketanz, Sebastian Möller
2024	—	`conf`	Occiglot at WMT24: European Open-source Large Language Models Evaluated on Translation. WMT Eleftherios Avramidis, Annika Grützner-Zahn, Manuel Brack, Patrick Schramowski, Pedro Ortiz Suarez, Malte Ostendorff, Fabio Barth, Shushen Manakhimova, Vivien Macketanz, Georg Rehm, Kristian Kersting
2023	—	`conf`	Challenging the State-of-the-art Machine Translation Metrics from a Linguistic Perspective. WMT Eleftherios Avramidis, Shushen Manakhimova, Vivien Macketanz, Sebastian Möller
2023	—	`conf`	Linguistically Motivated Evaluation of the 2023 State-of-the-art Machine Translation: Can ChatGPT Outperform NMT? WMT Shushen Manakhimova, Eleftherios Avramidis, Vivien Macketanz, Ekaterina Lapshinova-Koltunski, Sergei Bagdasarov, Sebastian Möller
2022	B	`conf`	A Linguistically Motivated Test Suite to Semi-Automatically Evaluate German-English Machine Translation Output. LREC Vivien Macketanz, Eleftherios Avramidis, Aljoscha Burchardt, He Wang, Renlong Ai, Shushen Manakhimova, Ursula Strohriegel, Sebastian Möller, Hans Uszkoreit
2022	—	`conf`	A Test Suite for the Evaluation of Portuguese-English Machine Translation. PROPOR Mariana Avelino, Vivien Macketanz, Eleftherios Avramidis, Sebastian Möller
2022	—	`conf`	Linguistically Motivated Evaluation of Machine Translation Metrics Based on a Challenge Set. WMT Eleftherios Avramidis, Vivien Macketanz
2022	—	`conf`	Linguistically Motivated Evaluation of the 2022 State-of-the-art Machine Translation Systems for Three Language Directions. WMT Vivien Macketanz, Shushen Manakhimova, Eleftherios Avramidis, Ekaterina Lapshinova-Koltunski, Sergei Bagdasarov, Sebastian Möller
2021	J	`jnl`	A new deal for translation quality. Univers. Access Inf. Soc. Aljoscha Burchardt, Arle Lommel, Vivien Macketanz
2021	—	`conf`	Linguistic Evaluation for the 2021 State-of-the-art Machine Translation Systems for German to English and English to German. WMT@EMNLP Vivien Macketanz, Eleftherios Avramidis, Shushen Manakhimova, Sebastian Möller
2021	—	`conf`	Observing the Learning Curve of NMT Systems With Regard to Linguistic Phenomena. ACL (student) Patrick Stadler, Vivien Macketanz, Eleftherios Avramidis
2020	—	`conf`	Fine-grained linguistic evaluation for state-of-the-art Machine Translation. WMT@EMNLP Eleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel, Aljoscha Burchardt, Sebastian Möller
2020	J	`jnl`	Fine-grained linguistic evaluation for state-of-the-art Machine Translation. CoRR Eleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel, Aljoscha Burchardt, Sebastian Möller
2019	J	`jnl`	Fine-grained evaluation of German-English Machine Translation based on a Test Suite. CoRR Vivien Macketanz, Eleftherios Avramidis, Aljoscha Burchardt, Hans Uszkoreit
2019	J	`jnl`	Fine-grained evaluation of Quality Estimation for Machine translation based on a linguistically-motivated Test Suite. CoRR Eleftherios Avramidis, Vivien Macketanz, Arle Lommel, Hans Uszkoreit
2019	—	`conf`	Linguistic Evaluation of German-English Machine Translation Using a Test Suite. WMT (2) Eleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel, Hans Uszkoreit
2019	J	`jnl`	Linguistic evaluation of German-English Machine Translation using a Test Suite. CoRR Eleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel, Hans Uszkoreit
2019	—	`conf`	Train, Sort, Explain: Learning to Diagnose Translation Models. NAACL-HLT (Demonstrations) Robert Schwarzenberg, David Harbecke, Vivien Macketanz, Eleftherios Avramidis, Sebastian Möller
2019	J	`jnl`	Train, Sort, Explain: Learning to Diagnose Translation Models. CoRR Robert Schwarzenberg, David Harbecke, Vivien Macketanz, Eleftherios Avramidis, Sebastian Möller
2018	—	`conf`	Fine-grained evaluation of German-English Machine Translation based on a Test Suite. WMT (shared task) Vivien Macketanz, Eleftherios Avramidis, Aljoscha Burchardt, Hans Uszkoreit
2018	—	`conf`	Fine-grained evaluation of Quality Estimation for Machine translation based on a linguistically motivated Test Suite. PostEditing@AMTA Eleftherios Avramidis, Vivien Macketanz, Arle Lommel, Hans Uszkoreit
2018	B	`conf`	TQ-AutoTest - An Automated Test Suite for (Machine) Translation Quality. LREC Vivien Macketanz, Renlong Ai, Aljoscha Burchardt, Hans Uszkoreit
2017	J	`jnl`	A Linguistic Evaluation of Rule-Based, Phrase-Based, and Neural MT Engines. Prague Bull. Math. Linguistics Aljoscha Burchardt, Vivien Macketanz, Jon Dehdari, Georg Heigold, Jan-Thorsten Peter, Philip Williams
2017	—	`conf`	CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies. CoNLL Shared Task (2) Daniel Zeman, Martin Popel, Milan Straka, Jan Hajic, Joakim Nivre, Filip Ginter, Juhani Luotolahti, Sampo Pyysalo, Slav Petrov, Martin Potthast, Francis M. Tyers, Elena Badmaeva, Memduh Gokirmak, Anna Nedoluzhko, Silvie Cinková, Jan Hajic Jr., Jaroslava Hlavácová, Václava Kettnerová, Zdenka Uresová, Jenna Kanerva, Stina Ojala, Anna Missilä, Christopher D. Manning, Sebastian Schuster, Siva Reddy, Dima Taji, Nizar Habash, Herman Leung, Marie-Catherine de Marneffe, Manuela Sanguinetti, Maria Simi, Hiroshi Kanayama, Valeria de Paiva, Kira Droganova, Héctor Martínez Alonso, Çagri Çöltekin, Umut Sulubacak, Hans Uszkoreit, Vivien Macketanz, Aljoscha Burchardt, Kim Harris, Katrin Marheinecke, Georg Rehm, Tolga Kayadelen, Mohammed Attia, Ali El-Kahky, Zhuoran Yu, Emily Pitler, Saran Lertpradit, Michael Mandl, Jesse Kirchner, Hector Fernandez Alcalde, Jana Strnadová, Esha Banerjee, Ruli Manurung, Antonio Stella, Atsuko Shimada, Sookyoung Kwak, Gustavo Mendonça, Tatiana Lando, Rattima Nitisaroj, Josie Li
2017	—	`conf`	Translation Quality and Productivity: A Study on Rich Morphology Languages. MTSummit (1) Lucia Specia, Kim Harris, Frédéric Blain, Aljoscha Burchardt, Vivien Macketanz, Inguna Skadina, Matteo Negri, Marco Turchi
2016	—	`conf`	Deeper Machine Translation and Evaluation for German. DMTW Eleftherios Avramidis, Vivien Macketanz, Aljoscha Burchardt, Jindrich Helcl, Hans Uszkoreit