Eleftherios Avramidis

94 papers A* 1B 10C 5Journal 26Unranked 50

Year	Rank	Type	Title / Venue / Authors
2025	J	`jnl`	A Critical Study of Automatic Evaluation in Sign Language Translation. CoRR Shakib Yazdani, Yasser Hamidullah, Cristina España-Bonet, Eleftherios Avramidis, Josef van Genabith
2025	—	`conf`	Evaluation of a Sign Language Avatar on Comprehensibility, User Experience & Acceptability. IVA (Adjunct) Fenya Wasserroth, Eleftherios Avramidis, Vera Czehmann, Tanja Kojic, Fabrizio Nunnari, Sebastian Möller
2025	J	`jnl`	Evaluation of a Sign Language Avatar on Comprehensibility, User Experience & Acceptability. CoRR Fenya Wasserroth, Eleftherios Avramidis, Vera Czehmann, Tanja Kojic, Fabrizio Nunnari, Sebastian Möller
2025	J	`jnl`	Preliminary Ranking of WMT25 General Machine Translation Systems. CoRR Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Konstantin Dranch, Anton Dvorkovich, Sergey Dukanov, Natalia Fedorova, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Howard Lakougna, Jessica Lundin, Kenton Murray, Masaaki Nagata, Stefano Perrella, Lorenzo Proietti, Martin Popel, Maja Popovic, Parker Riley, Mariya Shmatova, Steinþór Steingrímsson, Lisa Yankovskaya, Vilém Zouhar
2025	—	`conf`	Sign Language Video Segmentation Using Temporal Boundary Identification. ACL (4) Kavu Maithri Rao, Yasser Hamidullah, Eleftherios Avramidis
2025	—	`conf`	The Importance of Facial Features in Vision-based Sign Language Recognition: Eyes, Mouth or Full Face? IVA (Adjunct) Dinh Nam Pham, Eleftherios Avramidis
2025	J	`jnl`	The Importance of Facial Features in Vision-based Sign Language Recognition: Eyes, Mouth or Full Face? CoRR Dinh Nam Pham, Eleftherios Avramidis
2025	—	`conf`	The TUB Sign Language Corpus Collection. IVA (Adjunct) Eleftherios Avramidis, Vera Czehmann, Fabian Deckert, Lorenz Hufe, Aljoscha Lipski, Yuni Amaloa Quintero Villalobos, Tae Kwon Rhee, Mengqian Shi, Lennart Stölting, Fabrizio Nunnari, Sebastian Möller
2025	J	`jnl`	The TUB Sign Language Corpus Collection. CoRR Eleftherios Avramidis, Vera Czehmann, Fabian Deckert, Lorenz Hufe, Aljoscha Lipski, Yuni Amaloa Quintero Villalobos, Tae Kwon Rhee, Mengqian Shi, Lennart Stölting, Fabrizio Nunnari, Sebastian Möller
2025	B	`conf`	Transfer Learning from Visual Speech Recognition to Mouthing Recognition in German Sign Language. FG Dinh Nam Pham, Eleftherios Avramidis
2025	J	`jnl`	Transfer Learning from Visual Speech Recognition to Mouthing Recognition in German Sign Language. CoRR Dinh Nam Pham, Eleftherios Avramidis
2024	—	`conf`	Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task. WMT Markus Freitag, Nitika Mathur, Daniel Deutsch, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Frédéric Blain, Tom Kocmi, Jiayi Wang, David Ifeoluwa Adelani, Marianna Buchicchio, Chrysoula Zerva, Alon Lavie
2024	—	`conf`	DGS-Fabeln-1: A Multi-Angle Parallel Corpus of Fairy Tales between German Sign Language and German Text. LREC/COLING Fabrizio Nunnari, Eleftherios Avramidis, Cristina España-Bonet, Marco González, Anna Hennes, Patrick Gebhard
2024	—	`conf`	Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation. WMT Tom Kocmi, Vilém Zouhar, Eleftherios Avramidis, Roman Grundkiewicz, Marzena Karpinska, Maja Popovic, Mrinmaya Sachan, Mariya Shmatova
2024	J	`jnl`	Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation. CoRR Tom Kocmi, Vilém Zouhar, Eleftherios Avramidis, Roman Grundkiewicz, Marzena Karpinska, Maja Popovic, Mrinmaya Sachan, Mariya Shmatova
2024	—	`conf`	Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet. WMT Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Benjamin Marie, Christof Monz, Kenton Murray, Masaaki Nagata, Martin Popel, Maja Popovic, Mariya Shmatova, Steinthór Steingrímsson, Vilém Zouhar
2024	—	`conf`	Investigating the Linguistic Performance of Large Language Models in Machine Translation. WMT Shushen Manakhimova, Vivien Macketanz, Eleftherios Avramidis, Ekaterina Lapshinova-Koltunski, Sergei Bagdasarov, Sebastian Möller
2024	—	`conf`	Machine Translation Metrics Are Better in Evaluating Linguistic Errors on LLMs than on Encoder-Decoder Systems. WMT Eleftherios Avramidis, Shushen Manakhimova, Vivien Macketanz, Sebastian Möller
2024	—	`conf`	Occiglot at WMT24: European Open-source Large Language Models Evaluated on Translation. WMT Eleftherios Avramidis, Annika Grützner-Zahn, Manuel Brack, Patrick Schramowski, Pedro Ortiz Suarez, Malte Ostendorff, Fabio Barth, Shushen Manakhimova, Vivien Macketanz, Georg Rehm, Kristian Kersting
2024	J	`jnl`	Preliminary WMT24 Ranking of General MT Systems and LLMs. CoRR Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Benjamin Marie, Kenton Murray, Masaaki Nagata, Martin Popel, Maja Popovic, Mariya Shmatova, Steinþór Steingrímsson, Vilém Zouhar
2023	—	`conf`	Challenging the State-of-the-art Machine Translation Metrics from a Linguistic Perspective. WMT Eleftherios Avramidis, Shushen Manakhimova, Vivien Macketanz, Sebastian Möller
2023	B	`conf`	Disambiguating Signs: Deep Learning-based Gloss-level Classification for German Sign Language by Utilizing Mouth Actions. ESANN Dinh Nam Pham, Vera Czehmann, Eleftherios Avramidis
2023	—	`conf`	Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet. WMT Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Philipp Koehn, Benjamin Marie, Christof Monz, Makoto Morishita, Kenton Murray, Makoto Nagata, Toshiaki Nakazawa, Martin Popel, Maja Popovic, Mariya Shmatova
2023	—	`conf`	Findings of the Second WMT Shared Task on Sign Language Translation (WMT-SLT23). WMT Mathias Müller, Malihe Alikhani, Eleftherios Avramidis, Richard Bowden, Annelies Braffort, Necati Cihan Camgöz, Sarah Ebling, Cristina España-Bonet, Anne Göhring, Roman Grundkiewicz, Mert Inan, Zifan Jiang, Oscar Koller, Amit Moryossef, Annette Rios, Dimitar Shterionov, Sandra Sidler-Miserez, Katja Tissi, Davy Van Landuyt
2023	C	`conf`	First WMT Shared Task on Sign Language Translation (WMT-SLT22). EAMT Mathias Müller, Sarah Ebling, Eleftherios Avramidis, Alessia Battisti, Michèle Berger, Richard Bowden, Annelies Braffort, Necati Cihan Camgöz, Cristina España-Bonet, Roman Grundkiewicz, Zifan Jiang, Oscar Koller, Amit Moryossef, Regula Perrollaz, Sabine Reinhard, Annette Rios Gonzales, Dimitar Shterionov, Sandra Sidler-Miserez, Katja Tissi, Davy Van Landuyt
2023	—	`conf`	Linguistically Motivated Evaluation of the 2023 State-of-the-art Machine Translation: Can ChatGPT Outperform NMT? WMT Shushen Manakhimova, Eleftherios Avramidis, Vivien Macketanz, Ekaterina Lapshinova-Koltunski, Sergei Bagdasarov, Sebastian Möller
2023	—	`conf`	Neural Machine Translation Methods for Translating Text to Sign Language Glosses. ACL (1) Dele Zhu, Vera Czehmann, Eleftherios Avramidis
2023	—	`conf`	Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent. WMT Markus Freitag, Nitika Mathur, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Tom Kocmi, Frédéric Blain, Daniel Deutsch, Craig Stewart, Chrysoula Zerva, Sheila Castilho, Alon Lavie, George F. Foster
2023	—	`conf`	Textile Game Controller: Smart knee pads for Therapeutic Exercising. CHI Extended Abstracts Esther Friederike Zahn, Hannah Friederike Fischer, Clara Elisabeth Gleiß, Eleftherios Avramidis, Gesche Joost
2023	—	`conf`	Towards Incorporating 3D Space-Awareness Into an Augmented Reality Sign Language Interpreter. ICASSP Workshops Fabrizio Nunnari, Eleftherios Avramidis, Vemburaj Yadav, Alain Pagani, Yasser Hamidullah, Sepideh Mollanorozy, Cristina España-Bonet, Emil Woop, Patrick Gebhard
2022	B	`conf`	A Linguistically Motivated Test Suite to Semi-Automatically Evaluate German-English Machine Translation Output. LREC Vivien Macketanz, Eleftherios Avramidis, Aljoscha Burchardt, He Wang, Renlong Ai, Shushen Manakhimova, Ursula Strohriegel, Sebastian Möller, Hans Uszkoreit
2022	—	`conf`	A Test Suite for the Evaluation of Portuguese-English Machine Translation. PROPOR Mariana Avelino, Vivien Macketanz, Eleftherios Avramidis, Sebastian Möller
2022	—	`conf`	Experimental Machine Translation of the Swiss German Sign Language via 3D Augmentation of Body Keypoints. WMT Lorenz Hufe, Eleftherios Avramidis
2022	—	`conf`	Findings of the First WMT Shared Task on Sign Language Translation (WMT-SLT22). WMT Mathias Müller, Sarah Ebling, Eleftherios Avramidis, Alessia Battisti, Michèle Berger, Richard Bowden, Annelies Braffort, Necati Cihan Camgöz, Cristina España-Bonet, Roman Grundkiewicz, Zifan Jiang, Oscar Koller, Amit Moryossef, Regula Perrollaz, Sabine Reinhard, Annette Rios, Dimitar Shterionov, Sandra Sidler-Miserez, Katja Tissi
2022	—	`conf`	Linguistically Motivated Evaluation of Machine Translation Metrics Based on a Challenge Set. WMT Eleftherios Avramidis, Vivien Macketanz
2022	—	`conf`	Linguistically Motivated Evaluation of the 2022 State-of-the-art Machine Translation Systems for Three Language Directions. WMT Vivien Macketanz, Shushen Manakhimova, Eleftherios Avramidis, Ekaterina Lapshinova-Koltunski, Sergei Bagdasarov, Sebastian Möller
2022	—	`conf`	Results of WMT22 Metrics Shared Task: Stop Using BLEU - Neural Metrics Are Better and More Robust. WMT Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, Eleftherios Avramidis, Tom Kocmi, George F. Foster, Alon Lavie, André F. T. Martins
2022	—	`conf`	Using Neural Machine Translation Methods for Sign Language Translation. ACL (student) Galina Angelova, Eleftherios Avramidis, Sebastian Möller
2021	C	`conf`	A Data Augmentation Approach for Sign-Language-To-Text Translation In-The-Wild. LDK Fabrizio Nunnari, Cristina España-Bonet, Eleftherios Avramidis
2021	—	`conf`	Automatic generation of a 3D sign language avatar on AR glasses given 2D videos of human signers. AT4SSL@MTSummit Lan Thao Nguyen, Florian Schicktanz, Aeneas Stankowski, Eleftherios Avramidis
2021	B	`conf`	Evaluating the translation of speech to virtually-performed sign language on AR glasses. QoMEX Lan Thao Nguyen, Florian Schicktanz, Aeneas Stankowski, Eleftherios Avramidis
2021	—	`conf`	Linguistic Evaluation for the 2021 State-of-the-art Machine Translation Systems for German to English and English to German. WMT@EMNLP Vivien Macketanz, Eleftherios Avramidis, Shushen Manakhimova, Sebastian Möller
2021	—	`conf`	Observing the Learning Curve of NMT Systems With Regard to Linguistic Phenomena. ACL (student) Patrick Stadler, Vivien Macketanz, Eleftherios Avramidis
2020	—	`conf`	Fine-grained linguistic evaluation for state-of-the-art Machine Translation. WMT@EMNLP Eleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel, Aljoscha Burchardt, Sebastian Möller
2020	J	`jnl`	Fine-grained linguistic evaluation for state-of-the-art Machine Translation. CoRR Eleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel, Aljoscha Burchardt, Sebastian Möller
2020	J	`jnl`	SODECL: An Open-Source Library for Calculating Multiple Orbits of a System of Stochastic Differential Equations in Parallel. ACM Trans. Math. Softw. Eleftherios Avramidis, Marta Lalik, Ozgur E. Akman
2019	—	`—`	Comparative Quality Estimation for Machine Translation. An Application of Artificial Intelligence on Language Technology using Machine Learning of Human Preferences. Eleftherios Avramidis
2019	J	`jnl`	Fine-grained evaluation of German-English Machine Translation based on a Test Suite. CoRR Vivien Macketanz, Eleftherios Avramidis, Aljoscha Burchardt, Hans Uszkoreit
2019	J	`jnl`	Fine-grained evaluation of Quality Estimation for Machine translation based on a linguistically-motivated Test Suite. CoRR Eleftherios Avramidis, Vivien Macketanz, Arle Lommel, Hans Uszkoreit
2019	—	`conf`	Linguistic Evaluation of German-English Machine Translation Using a Test Suite. WMT (2) Eleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel, Hans Uszkoreit
2019	J	`jnl`	Linguistic evaluation of German-English Machine Translation using a Test Suite. CoRR Eleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel, Hans Uszkoreit
2019	J	`jnl`	SODECL: An Open Source Library for Calculating Multiple Orbits of a System of Stochastic Differential Equations in Parallel. CoRR Eleftherios Avramidis, Marta Lalik, Ozgur E. Akman
2019	—	`conf`	Train, Sort, Explain: Learning to Diagnose Translation Models. NAACL-HLT (Demonstrations) Robert Schwarzenberg, David Harbecke, Vivien Macketanz, Eleftherios Avramidis, Sebastian Möller
2019	J	`jnl`	Train, Sort, Explain: Learning to Diagnose Translation Models. CoRR Robert Schwarzenberg, David Harbecke, Vivien Macketanz, Eleftherios Avramidis, Sebastian Möller
2019	—	`conf`	Workshop on Wearables and Machine Learning: Applications of Artificial Intelligence, Approaches on Textile Technology. CHIuXiD Friederike Fröbel, Eleftherios Avramidis, Gesche Joost
2018	—	`conf`	Fine-grained evaluation of German-English Machine Translation based on a Test Suite. WMT (shared task) Vivien Macketanz, Eleftherios Avramidis, Aljoscha Burchardt, Hans Uszkoreit
2018	—	`conf`	Fine-grained evaluation of Quality Estimation for Machine translation based on a linguistically motivated Test Suite. PostEditing@AMTA Eleftherios Avramidis, Vivien Macketanz, Arle Lommel, Hans Uszkoreit
2017	J	`jnl`	Comparative Quality Estimation for Machine Translation Observations on Machine Learning and Features. Prague Bull. Math. Linguistics Eleftherios Avramidis
2017	J	`jnl`	Optimisation of an exemplar oculomotor model using multi-objective genetic algorithms executed on a GPU-CPU combination. BMC Syst. Biol. Eleftherios Avramidis, Ozgur E. Akman
2017	J	`jnl`	QE: : GUI - A Graphical User Interface for Quality Estimation. Prague Bull. Math. Linguistics Eleftherios Avramidis
2017	—	`conf`	Sentence-level quality estimation by predicting HTER as a multi-component metric. WMT Eleftherios Avramidis
2017	J	`jnl`	Sentence-level quality estimation by predicting HTER as a multi-component metric. CoRR Eleftherios Avramidis
2016	—	`conf`	DFKI's system for WMT16 IT-domain task, including analysis of systematic errors. WMT Eleftherios Avramidis
2016	—	`conf`	Deeper Machine Translation and Evaluation for German. DMTW Eleftherios Avramidis, Vivien Macketanz, Aljoscha Burchardt, Jindrich Helcl, Hans Uszkoreit
2016	J	`jnl`	Qualitative: Python Tool for MT Quality Estimation Supporting Server Mode and Hybrid MT. Prague Bull. Math. Linguistics Eleftherios Avramidis
2016	B	`conf`	Tools and Guidelines for Principled Machine Translation Development. LREC Nora Aranberri, Eleftherios Avramidis, Aljoscha Burchardt, Ondrej Klejch, Martin Popel, Maja Popovic
2015	—	`conf`	DFKI's experimental hybrid MT system for WMT 2015. WMT@EMNLP Eleftherios Avramidis, Maja Popovic, Aljoscha Burchardt
2015	J	`jnl`	MT-ComparEval: Graphical evaluation interface for Machine Translation development. Prague Bull. Math. Linguistics Ondrej Klejch, Eleftherios Avramidis, Aljoscha Burchardt, Martin Popel
2015	C	`conf`	Poor man's lemmatisation for automatic error classification. EAMT Maja Popovic, Mihael Arcan, Eleftherios Avramidis, Aljoscha Burchardt, Arle Lommel
2015	—	`conf`	Towards Deeper MT - A Hybrid System for German. DMTW Eleftherios Avramidis, Aljoscha Burchardt, Maja Popovic, Hans Uszkoreit
2014	—	`conf`	Correlating decoding events with errors in Statistical Machine Translation. ICON Eleftherios Avramidis, Maja Popovic
2014	—	`conf`	Efforts on Machine Learning over Human-mediated Translation Edit Rate. WMT@ACL Eleftherios Avramidis
2014	J	`jnl`	Involving language professionals in the evaluation of machine translation. Lang. Resour. Evaluation Maja Popovic, Eleftherios Avramidis, Aljoscha Burchardt, Sabine Hunsicker, Sven Schmeier, Cindy Tscherwinka, David Vilar, Hans Uszkoreit
2014	J	`jnl`	Qualitative: Open source Python tool for Quality Estimation over multiple Machine Translation outputs. Prague Bull. Math. Linguistics Eleftherios Avramidis, Lukas Poustka, Sven Schmeier
2014	C	`conf`	Relations between different types of post-editing operations, cognitive effort and temporal effort. EAMT Maja Popovic, Arle Lommel, Aljoscha Burchardt, Eleftherios Avramidis, Hans Uszkoreit
2014	B	`conf`	The taraXÜ corpus of human-annotated machine translations. LREC Eleftherios Avramidis, Aljoscha Burchardt, Sabine Hunsicker, Maja Popovic, Cindy Tscherwinka, David Vilar, Hans Uszkoreit
2014	C	`conf`	Using a new analytic measure for the annotation and analysis of MT errors on real data. EAMT Arle Lommel, Aljoscha Burchardt, Maja Popovic, Kim Harris, Eleftherios Avramidis, Hans Uszkoreit
2013	—	`conf`	A CCG-based Quality Estimation Metric for Statistical Machine Translation Learning from Human Judgments of Machine Translation Output. MTSummit (Posters) Maja Popovic, Eleftherios Avramidis, Aljoscha Burchardt, Sabine Hunsicker, Sven Schmeier, Cindy Tscherwinka, David Vilar
2013	—	`conf`	Learning from Human Judgments of Machine Translation Output. MTSummit (Posters) Maja Popovic, Eleftherios Avramidis, Aljoscha Burchardt, Sabine Hunsicker, Sven Schmeier, Cindy Tscherwinka, David Vilar
2013	—	`ch.`	Machine Translation at Work. Computational Linguistics - Applications Aljoscha Burchardt, Cindy Tscherwinka, Eleftherios Avramidis, Hans Uszkoreit
2013	J	`jnl`	QuEst - Design, Implementation and Extensions of a Framework for Machine Translation Quality Estimation. Prague Bull. Math. Linguistics Kashif Shah, Eleftherios Avramidis, Ergun Biçici, Lucia Specia
2013	J	`jnl`	RankEval: Open Tool for Evaluation of Machine-Learned Ranking. Prague Bull. Math. Linguistics Eleftherios Avramidis
2013	—	`conf`	Selecting Feature Sets for Comparative and Time-Oriented Quality Estimation of Machine Translation Output. WMT@ACL Eleftherios Avramidis, Maja Popovic
2013	J	`jnl`	Sentence-level ranking with quality estimation. Mach. Transl. Eleftherios Avramidis
2013	—	`conf`	What can we learn about the selection mechanism for post-editing? WPTP@MTSummit Maja Popovic, Eleftherios Avramidis, Aljoscha Burchardt, David Vilar, Hans Uszkoreit
2012	B	`conf`	A Richly Annotated, Multilingual Parallel Corpus for Hybrid Machine Translation. LREC Eleftherios Avramidis, Marta R. Costa-jussà, Christian Federmann, Josef van Genabith, Maite Melero, Pavel Pecina
2012	B	`conf`	Comparative Quality Estimation: Automatic Sentence-Level Ranking of Multiple Machine Translation Outputs. COLING Eleftherios Avramidis
2012	B	`conf`	Involving Language Professionals in the Evaluation of Machine Translation. LREC Eleftherios Avramidis, Aljoscha Burchardt, Christian Federmann, Maja Popovic, Cindy Tscherwinka, David Vilar
2012	—	`conf`	Quality estimation for Machine Translation output using linguistic analysis and decoding features. WMT@NAACL-HLT Eleftherios Avramidis
2012	B	`conf`	The ML4HMT Workshop on Optimising the Division of Labour in Hybrid Machine Translation. LREC Christian Federmann, Eleftherios Avramidis, Marta R. Costa-jussà, Josef van Genabith, Maite Melero, Pavel Pecina
2011	—	`conf`	DFKI's SC and MT submissions to IWSLT 2011. IWSLT David Vilar, Eleftherios Avramidis, Maja Popovic, Sabine Hunsicker
2011	—	`conf`	Evaluate with Confidence Estimation: Machine ranking of translation outputs using grammatical features. WMT@EMNLP Eleftherios Avramidis, Maja Popovic, David Vilar, Aljoscha Burchardt
2011	—	`conf`	Evaluation without references: IBM1 scores as evaluation metrics. WMT@EMNLP Maja Popovic, David Vilar, Eleftherios Avramidis, Aljoscha Burchardt
2008	A*	`conf`	Enriching Morphologically Poor Languages for Statistical Machine Translation. ACL Eleftherios Avramidis, Philipp Koehn