Markus Freitag

148 papers A* 12A 1C 1Journal 63Unranked 69

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	TranslateGemma Technical Report. CoRR Mara Finkelstein, Isaac Caswell, Tobias Domhan, Jan-Thorsten Peter, Juraj Juraska, Parker Riley, Daniel Deutsch, Geza Kovacs, Cole Dilanni, Colin Cherry, Eleftheria Briakou, Elizabeth Nielsen, Jiaming Luo, Kat Black, Ryan Mullins, Sweta Agrawal, Wenda Xu, Erin Kats, Stephane Jaskiewicz, Markus Freitag, David Vilar
2025	J	`jnl`	Deconstructing Self-Bias in LLM-generated Translation Benchmarks. CoRR Wenda Xu, Sweta Agrawal, Vilém Zouhar, Markus Freitag, Daniel Deutsch
2025	—	`conf`	Enhancing Human Evaluation in Machine Translation with Comparative Judgement. ACL (1) Yixiao Song, Parker Riley, Daniel Deutsch, Markus Freitag
2025	J	`jnl`	Enhancing Human Evaluation in Machine Translation with Comparative Judgment. CoRR Yixiao Song, Parker Riley, Daniel Deutsch, Markus Freitag
2025	J	`jnl`	Feeding Two Birds or Favoring One? Adequacy-Fluency Tradeoffs in Evaluation and Meta-Evaluation of Machine Translation. CoRR Behzad Shayegh, Jan-Thorsten Peter, David Vilar, Tobias Domhan, Juraj Juraska, Markus Freitag, Lili Mou
2025	A*	`conf`	From Jack of All Trades to Master of One: Specializing LLM-based Autoraters to a Test Set. ICML Mara Finkelstein, Daniel Deutsch, Parker Riley, Juraj Juraska, Geza Kovacs, Markus Freitag
2025	J	`jnl`	Generating Difficult-to-Translate Texts. CoRR Vilém Zouhar, Wenda Xu, Parker Riley, Juraj Juraska, Mara Finkelstein, Markus Freitag, Daniel Deutsch
2025	A*	`conf`	Learning from others' mistakes: Finetuning machine translation models with span-level error annotations. ICML Lily H. Zhang, Hamid Dadkhahi, Mara Finkelstein, Firas Trabelsi, Jiaming Luo, Markus Freitag
2025	J	`jnl`	MQM Re-Annotation: A Technique for Collaborative Evaluation of Machine Translation. CoRR Parker Riley, Daniel Deutsch, Mara Finkelstein, Colten DiIanni, Juraj Juraska, Markus Freitag
2025	J	`jnl`	MetricX-25 and GemSpanEval: Google Translate Submissions to the WMT25 Evaluation Shared Task. CoRR Juraj Juraska, Tobias Domhan, Mara Finkelstein, Tetsuji Nakagawa, Geza Kovacs, Daniel Deutsch, Pidong Wang, Markus Freitag
2025	J	`jnl`	Mind the Gap... or Not? How Translation Errors and Evaluation Details Skew Multilingual Results. CoRR Jan-Thorsten Peter, David Vilar, Tobias Domhan, Dan Malkin, Markus Freitag
2025	A*	`conf`	Overestimation in LLM Evaluation: A Controlled Large-Scale Study on Data Contamination's Impact on Machine Translation. ICML Muhammed Yusuf Kocyigit, Eleftheria Briakou, Daniel Deutsch, Jiaming Luo, Colin Cherry, Markus Freitag
2025	J	`jnl`	Overestimation in LLM Evaluation: A Controlled Large-Scale Study on Data Contamination's Impact on Machine Translation. CoRR Muhammed Yusuf Kocyigit, Eleftheria Briakou, Daniel Deutsch, Jiaming Luo, Colin Cherry, Markus Freitag
2025	J	`jnl`	Penalizing Length: Uncovering Systematic Bias in Quality Estimation Metrics. CoRR Yilin Zhang, Wenda Xu, Zhongtao Liu, Tetsuji Nakagawa, Markus Freitag
2025	J	`jnl`	Preliminary Ranking of WMT25 General Machine Translation Systems. CoRR Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Konstantin Dranch, Anton Dvorkovich, Sergey Dukanov, Natalia Fedorova, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Howard Lakougna, Jessica Lundin, Kenton Murray, Masaaki Nagata, Stefano Perrella, Lorenzo Proietti, Martin Popel, Maja Popovic, Parker Riley, Mariya Shmatova, Steinþór Steingrímsson, Lisa Yankovskaya, Vilém Zouhar
2025	J	`jnl`	Searching for Difficult-to-Translate Test Examples at Scale. CoRR Wenda Xu, Vilém Zouhar, Parker Riley, Mara Finkelstein, Markus Freitag, Daniel Deutsch
2025	—	`conf`	WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialects. ACL (Findings) Daniel Deutsch, Eleftheria Briakou, Isaac Rayburn Caswell, Mara Finkelstein, Rebecca Galor, Juraj Juraska, Geza Kovacs, Alison Lui, Ricardo Rei, Jason Riesa, Shruti Rijhwani, Parker Riley, Elizabeth Salesky, Firas Trabelsi, Stephanie Winkler, Biao Zhang, Markus Freitag
2025	J	`jnl`	WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialects. CoRR Daniel Deutsch, Eleftheria Briakou, Isaac Caswell, Mara Finkelstein, Rebecca Galor, Juraj Juraska, Geza Kovacs, Alison Lui, Ricardo Rei, Jason Riesa, Shruti Rijhwani, Parker Riley, Elizabeth Salesky, Firas Trabelsi, Stephanie Winkler, Biao Zhang, Markus Freitag
2025	J	`jnl`	You Cannot Feed Two Birds with One Score: the Accuracy-Naturalness Tradeoff in Translation. CoRR Gergely Flamich, David Vilar, Jan-Thorsten Peter, Markus Freitag
2024	—	`conf`	Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task. WMT Markus Freitag, Nitika Mathur, Daniel Deutsch, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Frédéric Blain, Tom Kocmi, Jiayi Wang, David Ifeoluwa Adelani, Marianna Buchicchio, Chrysoula Zerva, Alon Lavie
2024	—	`conf`	Beyond Human-Only: Evaluating Human-Machine Collaboration for Collecting High-Quality Translation Data. WMT Zhongtao Liu, Parker Riley, Daniel Deutsch, Alison Lui, Mengmeng Niu, Apurva Shah, Markus Freitag
2024	J	`jnl`	Beyond Human-Only: Evaluating Human-Machine Collaboration for Collecting High-Quality Translation Data. CoRR Zhongtao Liu, Parker Riley, Daniel Deutsch, Alison Lui, Mengmeng Niu, Apu Shah, Markus Freitag
2024	A*	`conf`	Efficient Minimum Bayes Risk Decoding using Low-Rank Matrix Completion Algorithms. NeurIPS Firas Trabelsi, David Vilar, Mara Finkelstein, Markus Freitag
2024	J	`jnl`	Efficient Minimum Bayes Risk Decoding using Low-Rank Matrix Completion Algorithms. CoRR Firas Trabelsi, David Vilar, Mara Finkelstein, Markus Freitag
2024	—	`conf`	Finding Replicable Human Evaluations via Stable Ranking Probability. NAACL-HLT Parker Riley, Daniel Deutsch, George F. Foster, Viresh Ratnakar, Ali Dabirmoghaddam, Markus Freitag
2024	J	`jnl`	Finding Replicable Human Evaluations via Stable Ranking Probability. CoRR Parker Riley, Daniel Deutsch, George F. Foster, Viresh Ratnakar, Ali Dabirmoghaddam, Markus Freitag
2024	—	`conf`	Findings of the Quality Estimation Shared Task at WMT 2024: Are LLMs Closing the Gap in QE? WMT Chrysoula Zerva, Frédéric Blain, José Guilherme Camargo de Souza, Diptesh Kanojia, Sourabh Dattatray Deoghare, Nuno Miguel Guerreiro, Giuseppe Attanasio, Ricardo Rei, Constantin Orasan, Matteo Negri, Marco Turchi, Rajen Chatterjee, Pushpak Bhattacharyya, Markus Freitag, André F. T. Martins
2024	—	`conf`	Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet. WMT Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Benjamin Marie, Christof Monz, Kenton Murray, Masaaki Nagata, Martin Popel, Maja Popovic, Mariya Shmatova, Steinthór Steingrímsson, Vilém Zouhar
2024	J	`jnl`	From Jack of All Trades to Master of One: Specializing LLM-based Autoraters to a Test Set. CoRR Mara Finkelstein, Daniel Deutsch, Parker Riley, Juraj Juraska, Geza Kovacs, Markus Freitag
2024	—	`conf`	Introducing the NewsPaLM MBR and QE Dataset: LLM-Generated High-Quality Parallel Data Outperforms Traditional Web-Crawled Data. WMT Mara Finkelstein, David Vilar, Markus Freitag
2024	J	`jnl`	Introducing the NewsPaLM MBR and QE Dataset: LLM-Generated High-Quality Parallel Data Outperforms Traditional Web-Crawled Data. CoRR Mara Finkelstein, David Vilar, Markus Freitag
2024	—	`conf`	LLMRefine: Pinpointing and Refining Large Language Models via Fine-Grained Actionable Feedback. NAACL-HLT (Findings) Wenda Xu, Daniel Deutsch, Mara Finkelstein, Juraj Juraska, Biao Zhang, Zhongtao Liu, William Yang Wang, Lei Li, Markus Freitag
2024	J	`jnl`	Learning from others' mistakes: Finetuning machine translation models with span-level error annotations. CoRR Lily H. Zhang, Hamid Dadkhahi, Mara Finkelstein, Firas Trabelsi, Jiaming Luo, Markus Freitag
2024	A*	`conf`	MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methods. ICLR Mara Finkelstein, Markus Freitag
2024	—	`conf`	MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task. WMT Juraj Juraska, Daniel Deutsch, Mara Finkelstein, Markus Freitag
2024	J	`jnl`	MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task. CoRR Juraj Juraska, Daniel Deutsch, Mara Finkelstein, Markus Freitag
2024	—	`conf`	Mitigating Metric Bias in Minimum Bayes Risk Decoding. WMT Geza Kovacs, Daniel Deutsch, Markus Freitag
2024	J	`jnl`	Mitigating Metric Bias in Minimum Bayes Risk Decoding. CoRR Geza Kovacs, Daniel Deutsch, Markus Freitag
2024	J	`jnl`	On the Implications of Verbose LLM Outputs: A Case Study in Translation Evaluation. CoRR Eleftheria Briakou, Zhongtao Liu, Colin Cherry, Markus Freitag
2024	J	`jnl`	Preliminary WMT24 Ranking of General MT Systems and LLMs. CoRR Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Benjamin Marie, Kenton Murray, Masaaki Nagata, Martin Popel, Maja Popovic, Mariya Shmatova, Steinþór Steingrímsson, Vilém Zouhar
2024	—	`conf`	Quality-Aware Translation Models: Efficient Generation and Quality Estimation in a Single Model. ACL (1) Christian Tomani, David Vilar, Markus Freitag, Colin Cherry, Subhajit Naskar, Mara Finkelstein, Xavier Garcia, Daniel Cremers
2024	—	`conf`	Translating Step-by-Step: Decomposing the Translation Process for Improved Translation Quality of Long-Form Texts. WMT Eleftheria Briakou, Jiaming Luo, Colin Cherry, Markus Freitag
2024	J	`jnl`	Translating Step-by-Step: Decomposing the Translation Process for Improved Translation Quality of Long-Form Texts. CoRR Eleftheria Briakou, Jiaming Luo, Colin Cherry, Markus Freitag
2023	—	`conf`	Epsilon Sampling Rocks: Investigating Sampling Strategies for Minimum Bayes Risk Decoding for Machine Translation. EMNLP (Findings) Markus Freitag, Behrooz Ghorbani, Patrick Fernandes
2023	J	`jnl`	Epsilon Sampling Rocks: Investigating Sampling Strategies for Minimum Bayes Risk Decoding for Machine Translation. CoRR Markus Freitag, Behrooz Ghorbani, Patrick Fernandes
2023	—	`conf`	Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet. WMT Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Philipp Koehn, Benjamin Marie, Christof Monz, Makoto Morishita, Kenton Murray, Makoto Nagata, Toshiaki Nakazawa, Martin Popel, Maja Popovic, Mariya Shmatova
2023	—	`conf`	Findings of the WMT 2023 Shared Task on Automatic Post-Editing. WMT Pushpak Bhattacharyya, Rajen Chatterjee, Markus Freitag, Diptesh Kanojia, Matteo Negri, Marco Turchi
2023	A*	`conf`	INSTRUCTSCORE: Towards Explainable Text Generation Evaluation with Automatic Feedback. EMNLP Wenda Xu, Danqing Wang, Liangming Pan, Zhenqiao Song, Markus Freitag, William Wang, Lei Li
2023	J	`jnl`	INSTRUCTSCORE: Towards Explainable Text Generation Evaluation with Automatic Feedback. CoRR Wenda Xu, Danqing Wang, Liangming Pan, Zhenqiao Song, Markus Freitag, William Yang Wang, Lei Li
2023	A*	`conf`	Language models are multilingual chain-of-thought reasoners. ICLR Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, Jason Wei
2023	J	`jnl`	MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methods. CoRR Mara Finkelstein, Subhajit Naskar, Mehdi Mirzazadeh, Apurva Shah, Markus Freitag
2023	—	`conf`	MetricX-23: The Google Submission to the WMT 2023 Metrics Shared Task. WMT Juraj Juraska, Mara Finkelstein, Daniel Deutsch, Aditya Siddhant, Mehdi Mirzazadeh, Markus Freitag
2023	J	`jnl`	PaLM 2 Technical Report. CoRR Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, Eric Chu, Jonathan H. Clark, Laurent El Shafey, Yanping Huang, Kathy Meier-Hellstern, Gaurav Mishra, Erica Moreira, Mark Omernick, Kevin Robinson, Sebastian Ruder, Yi Tay, Kefan Xiao, Yuanzhong Xu, Yujing Zhang, Gustavo Hernández Ábrego, Junwhan Ahn, Jacob Austin, Paul Barham, Jan A. Botha, James Bradbury, Siddhartha Brahma, Kevin Brooks, Michele Catasta, Yong Cheng, Colin Cherry, Christopher A. Choquette-Choo, Aakanksha Chowdhery, Clément Crepy, Shachi Dave, Mostafa Dehghani, Sunipa Dev, Jacob Devlin, Mark Díaz, Nan Du, Ethan Dyer, Vladimir Feinberg, Fangxiaoyu Feng, Vlad Fienber, Markus Freitag, Xavier Garcia, Sebastian Gehrmann, Lucas Gonzalez, et al.
2023	J	`jnl`	Pinpoint, Not Criticize: Refining Large Language Models via Fine-Grained Actionable Feedback. CoRR Wenda Xu, Daniel Deutsch, Mara Finkelstein, Juraj Juraska, Biao Zhang, Zhongtao Liu, William Yang Wang, Lei Li, Markus Freitag
2023	—	`conf`	Prompting PaLM for Translation: Assessing Strategies and Performance. ACL (1) David Vilar, Markus Freitag, Colin Cherry, Jiaming Luo, Viresh Ratnakar, George F. Foster
2023	J	`jnl`	Quality Control at Your Fingertips: Quality-Aware Translation Models. CoRR Christian Tomani, David Vilar, Markus Freitag, Colin Cherry, Subhajit Naskar, Mara Finkelstein, Daniel Cremers
2023	—	`conf`	Quality Estimation Using Minimum Bayes Risk. WMT Subhajit Naskar, Daniel Deutsch, Markus Freitag
2023	—	`conf`	Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent. WMT Markus Freitag, Nitika Mathur, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Tom Kocmi, Frédéric Blain, Daniel Deutsch, Craig Stewart, Chrysoula Zerva, Sheila Castilho, Alon Lavie, George F. Foster
2023	A*	`conf`	Scaling Laws for Multilingual Neural Machine Translation. ICML Patrick Fernandes, Behrooz Ghorbani, Xavier Garcia, Markus Freitag, Orhan Firat
2023	J	`jnl`	Scaling Laws for Multilingual Neural Machine Translation. CoRR Patrick Fernandes, Behrooz Ghorbani, Xavier Garcia, Markus Freitag, Orhan Firat
2023	—	`conf`	The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation. WMT Patrick Fernandes, Daniel Deutsch, Mara Finkelstein, Parker Riley, André F. T. Martins, Graham Neubig, Ankush Garg, Jonathan H. Clark, Markus Freitag, Orhan Firat
2023	J	`jnl`	The Devil is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation. CoRR Patrick Fernandes, Daniel Deutsch, Mara Finkelstein, Parker Riley, André F. T. Martins, Graham Neubig, Ankush Garg, Jonathan H. Clark, Markus Freitag, Orhan Firat
2023	—	`conf`	There's No Data like Better Data: Using QE Metrics for MT Data Filtering. WMT Jan-Thorsten Peter, David Vilar, Daniel Deutsch, Mara Finkelstein, Juraj Juraska, Markus Freitag
2023	J	`jnl`	There's no Data Like Better Data: Using QE Metrics for MT Data Filtering. CoRR Jan-Thorsten Peter, David Vilar, Daniel Deutsch, Mara Finkelstein, Juraj Juraska, Markus Freitag
2023	A*	`conf`	Ties Matter: Meta-Evaluating Modern Metrics with Pairwise Accuracy and Tie Calibration. EMNLP Daniel Deutsch, George F. Foster, Markus Freitag
2023	J	`jnl`	Ties Matter: Modifying Kendall's Tau for Modern Metric Meta-Evaluation. CoRR Daniel Deutsch, George F. Foster, Markus Freitag
2023	—	`conf`	Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level. WMT Daniel Deutsch, Juraj Juraska, Mara Finkelstein, Markus Freitag
2023	J	`jnl`	Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level. CoRR Daniel Deutsch, Juraj Juraska, Mara Finkelstein, Markus Freitag
2022	—	`conf`	A Natural Diet: Towards Improving Naturalness of Machine Translation Output. ACL (Findings) Markus Freitag, David Vilar, David Grangier, Colin Cherry, George F. Foster
2022	—	`conf`	Findings of the WMT 2022 Shared Task on Automatic Post-Editing. WMT Pushpak Bhattacharyya, Rajen Chatterjee, Markus Freitag, Diptesh Kanojia, Matteo Negri, Marco Turchi
2022	J	`jnl`	High Quality Rather than High Model Probability: Minimum Bayes Risk Decoding with Neural Metrics. Trans. Assoc. Comput. Linguistics Markus Freitag, David Grangier, Qijun Tan, Bowen Liang
2022	J	`jnl`	Language Models are Multilingual Chain-of-Thought Reasoners. CoRR Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, Jason Wei
2022	—	`conf`	On Systematic Style Differences between Unsupervised and Supervised MT and an Application for High-Resource Machine Translation. NAACL-HLT Kelly Marchisio, Markus Freitag, David Grangier
2022	—	`conf`	Original or Translated? A Causal Analysis of the Impact of Translationese on Machine Translation Performance. NAACL-HLT Jingwei Ni, Zhijing Jin, Markus Freitag, Mrinmaya Sachan, Bernhard Schölkopf
2022	J	`jnl`	Original or Translated? A Causal Analysis of the Impact of Translationese on Machine Translation Performance. CoRR Jingwei Ni, Zhijing Jin, Markus Freitag, Mrinmaya Sachan, Bernhard Schölkopf
2022	—	`ed.`	Proceedings of the Seventh Conference on Machine Translation, WMT 2022, Abu Dhabi, United Arab Emirates (Hybrid), December 7-8, 2022 WMT Philipp Koehn, Loïc Barrault, Ondrej Bojar, Fethi Bougares, Rajen Chatterjee, Marta R. Costa-jussà, Christian Federmann, Mark Fishel, Alexander Fraser, Markus Freitag, Yvette Graham, Roman Grundkiewicz, Paco Guzman, Barry Haddow, Matthias Huck, Antonio Jimeno-Yepes, Tom Kocmi, André F. T. Martins, Makoto Morishita, Christof Monz, Masaaki Nagata, Toshiaki Nakazawa, Matteo Negri, Aurélie Névéol, Mariana Neves, Martin Popel, Marco Turchi, Marcos Zampieri
2022	J	`jnl`	Prompting PaLM for Translation: Assessing Strategies and Performance. CoRR David Vilar, Markus Freitag, Colin Cherry, Jiaming Luo, Viresh Ratnakar, George F. Foster
2022	—	`conf`	Results of WMT22 Metrics Shared Task: Stop Using BLEU - Neural Metrics Are Better and More Robust. WMT Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, Eleftherios Avramidis, Tom Kocmi, George F. Foster, Alon Lavie, André F. T. Martins
2022	A*	`conf`	Scaling Laws for Neural Machine Translation. ICLR Behrooz Ghorbani, Orhan Firat, Markus Freitag, Ankur Bapna, Maxim Krikun, Xavier Garcia, Ciprian Chelba, Colin Cherry
2022	J	`jnl`	Toward More Effective Human Evaluation for Machine Translation. CoRR Belén Saldías, George F. Foster, Markus Freitag, Qijun Tan
2021	—	`conf`	Assessing Reference-Free Peer Evaluation for Machine Translation. NAACL-HLT Sweta Agrawal, George F. Foster, Markus Freitag, Colin Cherry
2021	J	`jnl`	Assessing Reference-Free Peer Evaluation for Machine Translation. CoRR Sweta Agrawal, George F. Foster, Markus Freitag, Colin Cherry
2021	J	`jnl`	Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation. CoRR Markus Freitag, George F. Foster, David Grangier, Viresh Ratnakar, Qijun Tan, Wolfgang Macherey
2021	J	`jnl`	Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation. Trans. Assoc. Comput. Linguistics Markus Freitag, George F. Foster, David Grangier, Viresh Ratnakar, Qijun Tan, Wolfgang Macherey
2021	—	`conf`	Findings of the 2021 Conference on Machine Translation (WMT21). WMT@EMNLP Farhad Akhbardeh, Arkady Arkhangorodsky, Magdalena Biesialska, Ondrej Bojar, Rajen Chatterjee, Vishrav Chaudhary, Marta R. Costa-jussà, Cristina España-Bonet, Angela Fan, Christian Federmann, Markus Freitag, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Leonie Harter, Kenneth Heafield, Christopher Homan, Matthias Huck, Kwabena Amponsah-Kaakyire, Jungo Kasai, Daniel Khashabi, Kevin Knight, Tom Kocmi, Philipp Koehn, Nicholas Lourie, Christof Monz, Makoto Morishita, Masaaki Nagata, Ajay Nagesh, Toshiaki Nakazawa, Matteo Negri, Santanu Pal, Allahsera Auguste Tapo, Marco Turchi, Valentin Vydrin, Marcos Zampieri
2021	J	`jnl`	Minimum Bayes Risk Decoding with Neural Metrics of Translation Quality. CoRR Markus Freitag, David Grangier, Qijun Tan, Bowen Liang
2021	—	`ed.`	Proceedings of the Sixth Conference on Machine Translation, WMT@EMNLP 2021, Online Event, November 10-11, 2021 WMT@EMNLP Loïc Barrault, Ondrej Bojar, Fethi Bougares, Rajen Chatterjee, Marta R. Costa-jussà, Christian Federmann, Mark Fishel, Alexander Fraser, Markus Freitag, Yvette Graham, Roman Grundkiewicz, Paco Guzman, Barry Haddow, Matthias Huck, Antonio Jimeno-Yepes, Philipp Koehn, Tom Kocmi, André F. T. Martins, Makoto Morishita, Christof Monz
2021	—	`conf`	Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain. WMT@EMNLP Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, George F. Foster, Alon Lavie, Ondrej Bojar
2021	J	`jnl`	Scaling Laws for Neural Machine Translation. CoRR Behrooz Ghorbani, Orhan Firat, Markus Freitag, Ankur Bapna, Maxim Krikun, Xavier Garcia, Ciprian Chelba, Colin Cherry
2021	J	`jnl`	Using Machine Translation to Localize Task Oriented NLG Output. CoRR Scott Roy, Cliff Brunk, Kyu-Young Kim, Justin Zhao, Markus Freitag, Mihir Kale, Gagan Bansal, Sidharth Mudgal, Chris Varano
2021	J	`jnl`	What Can Unsupervised Machine Translation Contribute to High-Resource Language Pairs? CoRR Kelly Marchisio, Markus Freitag, David Grangier
2020	—	`conf`	BLEU might be Guilty but References are not Innocent. EMNLP (1) Markus Freitag, David Grangier, Isaac Caswell
2020	J	`jnl`	BLEU might be Guilty but References are not Innocent. CoRR Markus Freitag, David Grangier, Isaac Caswell
2020	—	`conf`	Complete Multilingual Neural Machine Translation. WMT@EMNLP Markus Freitag, Orhan Firat
2020	J	`jnl`	Complete Multilingual Neural Machine Translation. CoRR Markus Freitag, Orhan Firat
2020	—	`conf`	Findings of the WMT 2020 Shared Task on Automatic Post-Editing. WMT@EMNLP Rajen Chatterjee, Markus Freitag, Matteo Negri, Marco Turchi
2020	—	`conf`	Human-Paraphrased References Improve Neural Machine Translation. WMT@EMNLP Markus Freitag, George F. Foster, David Grangier, Colin Cherry
2020	J	`jnl`	Human-Paraphrased References Improve Neural Machine Translation. CoRR Markus Freitag, George F. Foster, David Grangier, Colin Cherry
2020	—	`conf`	KoBE: Knowledge-Based Machine Translation Evaluation. EMNLP (Findings) Zorik Gekhman, Roee Aharoni, Genady Beryozkin, Markus Freitag, Wolfgang Macherey
2020	J	`jnl`	KoBE: Knowledge-Based Machine Translation Evaluation. CoRR Zorik Gekhman, Roee Aharoni, Genady Beryozkin, Markus Freitag, Wolfgang Macherey
2020	—	`conf`	Learning to Evaluate Translation Beyond English: BLEURT Submissions to the WMT Metrics 2020 Shared Task. WMT@EMNLP Thibault Sellam, Amy Pu, Hyung Won Chung, Sebastian Gehrmann, Qijun Tan, Markus Freitag, Dipanjan Das, Ankur P. Parikh
2020	J	`jnl`	Learning to Evaluate Translation Beyond English: BLEURT Submissions to the WMT Metrics 2020 Shared Task. CoRR Thibault Sellam, Amy Pu, Hyung Won Chung, Sebastian Gehrmann, Qijun Tan, Markus Freitag, Dipanjan Das, Ankur P. Parikh
2020	—	`conf`	Results of the WMT20 Metrics Shared Task. WMT@EMNLP Nitika Mathur, Johnny Wei, Markus Freitag, Qingsong Ma, Ondrej Bojar
2020	A*	`conf`	Translationese as a Language in "Multilingual" NMT. ACL Parker Riley, Isaac Caswell, Markus Freitag, David Grangier
2019	—	`conf`	APE at Scale and Its Implications on MT Evaluation Biases. WMT (1) Markus Freitag, Isaac Caswell, Scott Roy
2019	J	`jnl`	Text Repair Model for Neural Machine Translation. CoRR Markus Freitag, Isaac Caswell, Scott Roy
2019	J	`jnl`	Translationese as a Language in "Multilingual" NMT. CoRR Parker Riley, Isaac Caswell, Markus Freitag, David Grangier
2018	A*	`conf`	Unsupervised Natural Language Generation with Denoising Autoencoders. EMNLP Markus Freitag, Scott Roy
2018	J	`jnl`	Unsupervised Natural Language Generation with Denoising Autoencoders. CoRR Markus Freitag, Scott Roy
2017	J	`jnl`	Attention-based Vocabulary Selection for NMT Decoding. CoRR Baskaran Sankaran, Markus Freitag, Yaser Al-Onaizan
2017	—	`conf`	Beam Search Strategies for Neural Machine Translation. NMT@ACL Markus Freitag, Yaser Al-Onaizan
2017	J	`jnl`	Beam Search Strategies for Neural Machine Translation. CoRR Markus Freitag, Yaser Al-Onaizan
2017	J	`jnl`	Ensemble Distillation for Neural Machine Translation. CoRR Markus Freitag, Yaser Al-Onaizan, Baskaran Sankaran
2017	J	`jnl`	Local System Voting Feature for Machine Translation System Combination. CoRR Markus Freitag, Jan-Thorsten Peter, Stephan Peitz, Minwei Feng, Hermann Ney
2016	J	`jnl`	Fast Domain Adaptation for Neural Machine Translation. CoRR Markus Freitag, Yaser Al-Onaizan
2015	—	`conf`	Local System Voting Feature for Machine Translation System Combination. WMT@EMNLP Markus Freitag, Jan-Thorsten Peter, Stephan Peitz, Minwei Feng, Hermann Ney
2014	—	`conf`	Better punctuation prediction with hierarchical phrase-based translation. IWSLT Stephan Peitz, Markus Freitag, Hermann Ney
2014	—	`conf`	Combined spoken language translation. IWSLT (Evaluation Campaign) Markus Freitag, Joern Wuebker, Stephan Peitz, Hermann Ney, Matthias Huck, Alexandra Birch, Nadir Durrani, Philipp Koehn, Mohammed Mediani, Isabel Slawik, Jan Niehues, Eunach Cho, Alex Waibel, Nicola Bertoldi, Mauro Cettolo, Marcello Federico
2014	—	`conf`	EU-BRIDGE MT: Combined Machine Translation. WMT@ACL Markus Freitag, Stephan Peitz, Joern Wuebker, Hermann Ney, Matthias Huck, Rico Sennrich, Nadir Durrani, Maria Nadejde, Philip Williams, Philipp Koehn, Teresa Herrmann, Eunah Cho, Alex Waibel
2014	—	`conf`	Improved MEMS AE sensors in HARM technology. SSD R. Sommer, Markus Freitag, Jörg Schaufuss, Alexander Sorger, Jan Mehner
2014	A	`conf`	Jane: Open Source Machine Translation System Combination. EACL Markus Freitag, Matthias Huck, Hermann Ney
2014	—	`conf`	The RWTH Aachen German-English Machine Translation System for WMT 2014. WMT@ACL Stephan Peitz, Joern Wuebker, Markus Freitag, Hermann Ney
2013	—	`conf`	A Performance Study of Cube Pruning for Large-Scale Hierarchical Machine Translation. SSST@NAACL-HLT Matthias Huck, David Vilar, Markus Freitag, Hermann Ney
2013	—	`conf`	EU-BRIDGE MT: text translation of talks in the EU-BRIDGE project. IWSLT (Evaluation Campaign) Markus Freitag, Stephan Peitz, Joern Wuebker, Hermann Ney, Nadir Durrani, Matthias Huck, Philipp Koehn, Thanh-Le Ha, Jan Niehues, Mohammed Mediani, Teresa Herrmann, Alex Waibel, Nicola Bertoldi, Mauro Cettolo, Marcello Federico
2013	—	`conf`	Joint WMT 2013 Submission of the QUAERO Project. WMT@ACL Stephan Peitz, Saab Mansour, Matthias Huck, Markus Freitag, Hermann Ney, Eunah Cho, Teresa Herrmann, Mohammed Mediani, Jan Niehues, Alex Waibel, Alexandre Allauzen, Quoc-Khanh Do, Bianka Buschbeck, Tonio Wandmacher
2013	—	`conf`	Reverse Word Order Model. MTSummit Markus Freitag, Minwei Feng, Matthias Huck, Stephan Peitz, Hermann Ney
2013	—	`conf`	The RWTH Aachen Machine Translation System for WMT 2013. WMT@ACL Stephan Peitz, Saab Mansour, Jan-Thorsten Peter, Christoph Schmidt, Joern Wuebker, Matthias Huck, Markus Freitag, Hermann Ney
2013	—	`conf`	The RWTH Aachen System for NTCIR-10 PatentMT. NTCIR Minwei Feng, Christoph Schmidt, Joern Wuebker, Markus Freitag, Hermann Ney
2013	—	`conf`	The RWTH Aachen machine translation systems for IWSLT 2013. IWSLT (Evaluation Campaign) Joern Wuebker, Stephan Peitz, Tamer Alkhouli, Jan-Thorsten Peter, Minwei Feng, Markus Freitag, Hermann Ney
2013	—	`conf`	The System Combination RWTH Aachen: SYSTRAN for the NTCIR-10 PatentMT Evaluation. NTCIR Minwei Feng, Markus Freitag, Hermann Ney, Bianka Buschbeck, Jean Senellart, Jin Yang
2012	—	`conf`	CFD analysis of viscous losses in complex microsystems. SSD Alexander Sorger, Markus Freitag, Alexey Shaporin, Jan Mehner
2012	C	`conf`	Discriminative Reordering Extensions for Hierarchical Phrase-Based Machine Translation. EAMT Matthias Huck, Stephan Peitz, Markus Freitag, Hermann Ney
2012	—	`conf`	GovWILD: integrating open government data for transparency. WWW (Companion Volume) Christoph Böhm, Markus Freitag, Arvid Heise, Claudia Lehmann, Andrina Mascher, Felix Naumann, Vuk Ercegovac, Mauricio A. Hernández, Peter Haase, Michael Schmidt
2012	J	`jnl`	Hierarchical Phrase-Based Translation with Jane 2. Prague Bull. Math. Linguistics Matthias Huck, Jan-Thorsten Peter, Markus Freitag, Stephan Peitz, Hermann Ney
2012	—	`conf`	Jane 2: Open Source Phrase-based and Hierarchical Statistical Machine Translation. COLING (Demos) Joern Wuebker, Matthias Huck, Stephan Peitz, Malte Nuhn, Markus Freitag, Jan-Thorsten Peter, Saab Mansour, Hermann Ney
2012	—	`conf`	Joint WMT 2012 Submission of the QUAERO Project. WMT@NAACL-HLT Markus Freitag, Stephan Peitz, Matthias Huck, Hermann Ney, Jan Niehues, Teresa Herrmann, Alex Waibel, Hai Son Le, Thomas Lavergne, Alexandre Allauzen, Bianka Buschbeck, Josep Maria Crego, Jean Senellart
2012	—	`conf`	Review of Hypothesis Alignment Algorithms for MT System Combination via Confusion Network Decoding. WMT@NAACL-HLT Antti-Veikko I. Rosti, Xiaodong He, Damianos G. Karakos, Gregor Leusch, Yuan Cao, Markus Freitag, Spyros Matsoukas, Hermann Ney, Jason Smith, Bing Zhang
2012	—	`conf`	The RWTH Aachen Machine Translation System for WMT 2012. WMT@NAACL-HLT Matthias Huck, Stephan Peitz, Markus Freitag, Malte Nuhn, Hermann Ney
2012	—	`conf`	The RWTH Aachen speech recognition and machine translation system for IWSLT 2012. IWSLT Stephan Peitz, Saab Mansour, Markus Freitag, Minwei Feng, Matthias Huck, Joern Wuebker, Malte Nuhn, Markus Nußbaum-Thom, Hermann Ney
2011	J	`jnl`	A Guide to Jane, an Open Source Hierarchical Translation Toolkit. Prague Bull. Math. Linguistics Daniel Stein, David Vilar, Stephan Peitz, Markus Freitag, Matthias Huck, Hermann Ney
2011	—	`conf`	Advances on spoken language translation in the Quaero program. IWSLT Karim Boudahmane, Bianka Buschbeck, Eunah Cho, Josep Maria Crego, Markus Freitag, Thomas Lavergne, Hermann Ney, Jan Niehues, Stephan Peitz, Jean Senellart, Artem Sokolov, Alex Waibel, Tonio Wandmacher, Joern Wuebker, François Yvon
2011	—	`conf`	Joint WMT Submission of the QUAERO Project. WMT@EMNLP Markus Freitag, Gregor Leusch, Joern Wuebker, Stephan Peitz, Hermann Ney, Teresa Herrmann, Jan Niehues, Alex Waibel, Alexandre Allauzen, Gilles Adda, Josep Maria Crego, Bianka Buschbeck, Tonio Wandmacher, Jean Senellart
2011	—	`conf`	Modeling punctuation prediction as machine translation. IWSLT Stephan Peitz, Markus Freitag, Arne Mauser, Hermann Ney
2011	—	`conf`	The RWTH Aachen Machine Translation System for WMT 2011. WMT@EMNLP Matthias Huck, Joern Wuebker, Christoph Schmidt, Markus Freitag, Stephan Peitz, Daniel Stein, Arnaud Dagnelies, Saab Mansour, Gregor Leusch, Hermann Ney
2011	—	`conf`	The RWTH Aachen System for NTCIR-9 PatentMT. NTCIR Minwei Feng, Christoph Schmidt, Joern Wuebker, Stephan Peitz, Markus Freitag, Hermann Ney
2011	—	`conf`	The RWTH Aachen machine translation system for IWSLT 2011. IWSLT Joern Wuebker, Matthias Huck, Saab Mansour, Markus Freitag, Minwei Feng, Stephan Peitz, Christoph Schmidt, Hermann Ney
2011	—	`conf`	The RWTH System Combination System for WMT 2011. WMT@EMNLP Gregor Leusch, Markus Freitag, Hermann Ney
2010	—	`conf`	Linking open government data: what journalists wish they had known. I-SEMANTICS Christoph Böhm, Felix Naumann, Markus Freitag, Stefan George, Norman Höfler, Martin Köppelmann, Claudia Lehmann, Andrina Mascher, Tobias Schmidt