Vilém Zouhar - RankMe

96 papers A* 7A 1B 2Journal 61Unranked 25

Year	Rank	Type	Title / Venue / Authors
2026	—	`conf`	Can Reasoning Help Large Language Models Capture Human Annotator Disagreement? EACL (Volume 1: Long Papers) Jingwei Ni, Yu Fan, Vilém Zouhar, Donya Rooein, Alexander Miserlis Hoyle, Mrinmaya Sachan, Markus Leippold, Dirk Hovy, Elliott Ash
2026	—	`conf`	Early-Exit and Instant Confidence Translation Quality Estimation. EACL (Volume 1: Long Papers) Vilém Zouhar, Maike Züfle, Beni Egressy, Julius Cheng, Mrinmaya Sachan, Jan Niehues
2026	—	`conf`	How Important is 'Perfect' English for Machine Translation Prompts? EACL (Findings) Patrícia Schmidtová, Niyati Bafna, Seth Aycock, Gianluca Vico, Wiktor Kamzela, Kathy Hämmerl, Vilém Zouhar
2026	J	`jnl`	Pearmut: Human Evaluation of Translation Made Trivial. CoRR Vilém Zouhar, Tom Kocmi
2026	J	`jnl`	Understanding Large Language Model Behaviors Through Interactive Counterfactual Generation and Analysis. IEEE Trans. Vis. Comput. Graph. Furui Cheng, Vilém Zouhar, Robin Shing Moon Chan, Daniel Fürst, Hendrik Strobelt, Mennatallah El-Assady
2026	J	`jnl`	When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation. CoRR Mubashara Akhtar, Anka Reuel, Prajna Soni, Sanchit Ahuja, Pawan Sasanka Ammanamanchi, Ruchit Rawal, Vilém Zouhar, Srishti Yadav, Chenxi Whitehouse, Dayeon Ki, Jennifer Mickel, Leshem Choshen, Marek Suppa, Jan Batzner, Jenny Chim, Jeba Sania, Yanan Long, Hossein A. Rahmani, Christina Knight, Yiyang Nan, Jyoutir Raj, Yu Fan, Shubham Singh, Subramanyam Sahoo, Eliya Habba, Usman Gohar, Siddhesh Pawar, Robert Scholz, Arjun Subramonian, Jingwei Ni, Mykel J. Kochenderfer, Sanmi Koyejo, Mrinmaya Sachan, Stella Biderman, Zeerak Talat, Avijit Ghosh, Irene Solaiman
2025	—	`conf`	A Bayesian Optimization Approach to Machine Translation Reranking. NAACL (Long Papers) Julius Cheng, Maike Züfle, Vilém Zouhar, Andreas Vlachos
2025	—	`conf`	AI-Assisted Human Evaluation of Machine Translation. NAACL (Long Papers) Vilém Zouhar, Tom Kocmi, Mrinmaya Sachan
2025	A*	`conf`	Biased Tales: Cultural and Topic Bias in Generating Children's Stories. EMNLP Donya Rooein, Vilém Zouhar, Debora Nozza, Dirk Hovy
2025	J	`jnl`	Biased Tales: Cultural and Topic Bias in Generating Children's Stories. CoRR Donya Rooein, Vilém Zouhar, Debora Nozza, Dirk Hovy
2025	J	`jnl`	COMET-poly: Machine Translation Metric Grounded in Other Candidates. CoRR Maike Züfle, Vilém Zouhar, Tu Anh Dinh, Felipe Maia Polo, Jan Niehues, Mrinmaya Sachan
2025	—	`conf`	CafGa: Customizing Feature Attributions to Explain Language Models. EMNLP (System Demonstrations) Alan Boyle, Furui Cheng, Vilém Zouhar, Mennatallah El-Assady
2025	J	`jnl`	CafGa: Customizing Feature Attributions to Explain Language Models. CoRR Alan Boyle, Furui Cheng, Vilém Zouhar, Mennatallah El-Assady
2025	J	`jnl`	Can Large Language Models Capture Human Annotator Disagreements? CoRR Jingwei Ni, Yu Fan, Vilém Zouhar, Donya Rooein, Alexander Miserlis Hoyle, Mrinmaya Sachan, Markus Leippold, Dirk Hovy, Elliott Ash
2025	—	`conf`	Co-DETECT: Collaborative Discovery of Edge Cases in Text Classification. EMNLP (System Demonstrations) Chenfei Xiong, Jingwei Ni, Yu Fan, Vilém Zouhar, Donya Rooein, Lorena Calvo-Bartolomé, Alexander Miserlis Hoyle, Zhijing Jin, Mrinmaya Sachan, Markus Leippold, Dirk Hovy, Mennatallah El-Assady, Elliott Ash
2025	J	`jnl`	Co-DETECT: Collaborative Discovery of Edge Cases in Text Classification. CoRR Chenfei Xiong, Jingwei Ni, Yu Fan, Vilém Zouhar, Donya Rooein, Lorena Calvo-Bartolomé, Alexander Miserlis Hoyle, Zhijing Jin, Mrinmaya Sachan, Markus Leippold, Dirk Hovy, Mennatallah El-Assady, Elliott Ash
2025	J	`jnl`	Deconstructing Self-Bias in LLM-generated Translation Benchmarks. CoRR Wenda Xu, Sweta Agrawal, Vilém Zouhar, Markus Freitag, Daniel Deutsch
2025	J	`jnl`	Early-Exit and Instant Confidence Translation Quality Estimation. CoRR Vilém Zouhar, Maike Züfle, Beni Egressy, Julius Cheng, Jan Niehues
2025	—	`conf`	Estimating Machine Translation Difficulty. EMNLP (Findings) Lorenzo Proietti, Stefano Perrella, Vilém Zouhar, Roberto Navigli, Tom Kocmi
2025	J	`jnl`	Estimating Machine Translation Difficulty. CoRR Lorenzo Proietti, Stefano Perrella, Vilém Zouhar, Roberto Navigli, Tom Kocmi
2025	J	`jnl`	Generating Difficult-to-Translate Texts. CoRR Vilém Zouhar, Wenda Xu, Parker Riley, Juraj Juraska, Mara Finkelstein, Markus Freitag, Daniel Deutsch
2025	J	`jnl`	Harmonizing Assistance: Moderating Visual and Textual Aids in AI-Enhanced Textbook Reading with IRead. Int. J. Artif. Intell. Educ. Xiaoyu Zhang, Vincent Dörig, Peng Cui, Vilém Zouhar, Torbjørn H. Netland, Mrinmaya Sachan
2025	J	`jnl`	Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMs. CoRR Sara Papi, Javier García Gilabert, Zachary William Hopton, Vilém Zouhar, Carlos Escolano, Gerard I. Gállego, Jorge Iranzo-Sánchez, Ahrii Kim, Dominik Machácek, Patrícia Schmidtová, Maike Züfle
2025	J	`jnl`	How Important is 'Perfect' English for Machine Translation Prompts? CoRR Patrícia Schmidtová, Niyati Bafna, Seth Aycock, Gianluca Vico, Wiktor Kamzela, Katharina Hämmerl, Vilém Zouhar
2025	J	`jnl`	How to Select Datapoints for Efficient Human Evaluation of NLG Models? CoRR Vilém Zouhar, Peng Cui, Mrinmaya Sachan
2025	J	`jnl`	How to Select Datapoints for Efficient Human Evaluation of NLG Models? Trans. Assoc. Comput. Linguistics Vilém Zouhar, Peng Cui, Mrinmaya Sachan
2025	J	`jnl`	Large Language Models as Span Annotators. CoRR Zdenek Kasner, Vilém Zouhar, Patrícia Schmidtová, Ivan Kartác, Kristýna Onderková, Ondrej Plátek, Dimitra Gkatzia, Saad Mahamood, Ondrej Dusek, Simone Balloccu
2025	J	`jnl`	Multilingual Performance Biases of Large Language Models in Education. CoRR Vansh Gupta, Sankalan Pal Chowdhury, Vilém Zouhar, Donya Rooein, Mrinmaya Sachan
2025	J	`jnl`	Preliminary Ranking of WMT25 General Machine Translation Systems. CoRR Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Konstantin Dranch, Anton Dvorkovich, Sergey Dukanov, Natalia Fedorova, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Howard Lakougna, Jessica Lundin, Kenton Murray, Masaaki Nagata, Stefano Perrella, Lorenzo Proietti, Martin Popel, Maja Popovic, Parker Riley, Mariya Shmatova, Steinþór Steingrímsson, Lisa Yankovskaya, Vilém Zouhar
2025	J	`jnl`	QE4PE: Word-level Quality Estimation for Human Post-Editing. CoRR Gabriele Sarti, Vilém Zouhar, Grzegorz Chrupala, Ana Guerberof Arenas, Malvina Nissim, Arianna Bisazza
2025	J	`jnl`	QE4PE: Word-level Quality Estimation for Human Post-Editing. Trans. Assoc. Comput. Linguistics Gabriele Sarti, Vilém Zouhar, Grzegorz Chrupala, Ana Guerberof Arenas, Malvina Nissim, Arianna Bisazza
2025	J	`jnl`	Searching for Difficult-to-Translate Test Examples at Scale. CoRR Wenda Xu, Vilém Zouhar, Parker Riley, Mara Finkelstein, Markus Freitag, Daniel Deutsch
2025	A*	`conf`	Unsupervised Word-level Quality Estimation for Machine Translation Through the Lens of Annotators (Dis)agreement. EMNLP Gabriele Sarti, Vilém Zouhar, Malvina Nissim, Arianna Bisazza
2025	J	`jnl`	Unsupervised Word-level Quality Estimation for Machine Translation Through the Lens of Annotators (Dis)agreement. CoRR Gabriele Sarti, Vilém Zouhar, Malvina Nissim, Arianna Bisazza
2024	J	`jnl`	A Bayesian Optimization Approach to Machine Translation Reranking. CoRR Julius Cheng, Maike Züfle, Vilém Zouhar, Andreas Vlachos
2024	J	`jnl`	AI-Assisted Human Evaluation of Machine Translation. CoRR Vilém Zouhar, Tom Kocmi, Mrinmaya Sachan
2024	B	`conf`	AutoTutor meets Large Language Models: A Language Model Tutor with Rich Pedagogy and Guardrails. L@S Sankalan Pal Chowdhury, Vilém Zouhar, Mrinmaya Sachan
2024	A*	`conf`	Distributional Properties of Subword Regularization. EMNLP Marco Cognetta, Vilém Zouhar, Naoaki Okazaki
2024	J	`jnl`	Distributional Properties of Subword Regularization. CoRR Marco Cognetta, Vilém Zouhar, Naoaki Okazaki
2024	—	`conf`	Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation. WMT Tom Kocmi, Vilém Zouhar, Eleftherios Avramidis, Roman Grundkiewicz, Marzena Karpinska, Maja Popovic, Mrinmaya Sachan, Mariya Shmatova
2024	J	`jnl`	Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation. CoRR Tom Kocmi, Vilém Zouhar, Eleftherios Avramidis, Roman Grundkiewicz, Marzena Karpinska, Maja Popovic, Mrinmaya Sachan, Mariya Shmatova
2024	—	`conf`	Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet. WMT Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Benjamin Marie, Christof Monz, Kenton Murray, Masaaki Nagata, Martin Popel, Maja Popovic, Mariya Shmatova, Steinthór Steingrímsson, Vilém Zouhar
2024	—	`conf`	Fine-Tuned Machine Translation Metrics Struggle in Unseen Domains. ACL (Short Papers) Vilém Zouhar, Shuoyang Ding, Anna Currey, Tatyana Badeka, Jenyuan Wang, Brian Thompson
2024	J	`jnl`	Fine-Tuned Machine Translation Metrics Struggle in Unseen Domains. CoRR Vilém Zouhar, Shuoyang Ding, Anna Currey, Tatyana Badeka, Jenyuan Wang, Brian Thompson
2024	J	`jnl`	How to Engage Your Readers? Generating Guiding Questions to Promote Active Reading. CoRR Peng Cui, Vilém Zouhar, Xiaoyu Zhang, Mrinmaya Sachan
2024	—	`conf`	How to Engage your Readers? Generating Guiding Questions to Promote Active Reading. ACL (1) Peng Cui, Vilém Zouhar, Xiaoyu Zhang, Mrinmaya Sachan
2024	J	`jnl`	Interactive Analysis of LLMs using Meaningful Counterfactuals. CoRR Furui Cheng, Vilém Zouhar, Robin Shing Moon Chan, Daniel Fürst, Hendrik Strobelt, Mennatallah El-Assady
2024	—	`conf`	Multimodal Shannon Game with Images. LOD (3) Vilém Zouhar, Sunit Bhattacharya, Ondrej Bojar
2024	—	`conf`	Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies. ACL (1) Tom Kocmi, Vilém Zouhar, Christian Federmann, Matt Post
2024	J	`jnl`	Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies. CoRR Tom Kocmi, Vilém Zouhar, Christian Federmann, Matt Post
2024	—	`conf`	PWESuite: Phonetic Word Embeddings and Tasks They Facilitate. LREC/COLING Vilém Zouhar, Kalvin Chang, Chenxuan Cui, Nate B. Carlson, Nathaniel Romney Robinson, Mrinmaya Sachan, David R. Mortensen
2024	—	`conf`	Pitfalls and Outlooks in Using COMET. WMT Vilém Zouhar, Pinzhen Chen, Tsz Kin Lam, Nikita Moghe, Barry Haddow
2024	J	`jnl`	Pitfalls and Outlooks in Using COMET. CoRR Vilém Zouhar, Pinzhen Chen, Tsz Kin Lam, Nikita Moghe, Barry Haddow
2024	J	`jnl`	Preliminary WMT24 Ranking of General MT Systems and LLMs. CoRR Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Benjamin Marie, Kenton Murray, Masaaki Nagata, Martin Popel, Maja Popovic, Mariya Shmatova, Steinþór Steingrímsson, Vilém Zouhar
2024	J	`jnl`	Quality and Quantity of Machine Translation References for Automated Metrics. CoRR Vilém Zouhar, Ondrej Bojar
2024	A*	`conf`	RELIC: Investigating Large Language Model Responses using Self-Consistency. CHI Furui Cheng, Vilém Zouhar, Simran Arora, Mrinmaya Sachan, Hendrik Strobelt, Mennatallah El-Assady
2024	J	`jnl`	Scaling the Authoring of AutoTutors with Large Language Models. CoRR Sankalan Pal Chowdhury, Vilém Zouhar, Mrinmaya Sachan
2024	J	`jnl`	Stolen Subwords: Importance of Vocabularies for Machine Translation Model Stealing. CoRR Vilém Zouhar
2024	—	`conf`	Two Counterexamples to Tokenization and the Noiseless Channel. LREC/COLING Marco Cognetta, Vilém Zouhar, Sangwhan Moon, Naoaki Okazaki
2024	J	`jnl`	Two Counterexamples to Tokenization and the Noiseless Channel. CoRR Marco Cognetta, Vilém Zouhar, Sangwhan Moon, Naoaki Okazaki
2023	J	`jnl`	A Decade of Scholarly Research on Open Knowledge Graphs. CoRR Houcemeddine Turki, Abraham Toluwase Owodunni, Mohamed Ali Hadj Taieb, René Fabrice Bile, Mohamed Ben Aouicha, Vilém Zouhar
2023	A*	`conf`	A Diachronic Perspective on User Trust in AI under Uncertainty. EMNLP Shehzaad Dhuliawala, Vilém Zouhar, Mennatallah El-Assady, Mrinmaya Sachan
2023	J	`jnl`	A Diachronic Perspective on User Trust in AI under Uncertainty. CoRR Shehzaad Dhuliawala, Vilém Zouhar, Mennatallah El-Assady, Mrinmaya Sachan
2023	—	`conf`	A Formal Perspective on Byte-Pair Encoding. ACL (Findings) Vilém Zouhar, Clara Meister, Juan Luis Gastaldi, Li Du, Tim Vieira, Mrinmaya Sachan, Ryan Cotterell
2023	J	`jnl`	A Formal Perspective on Byte-Pair Encoding. CoRR Vilém Zouhar, Clara Meister, Juan Luis Gastaldi, Li Du, Tim Vieira, Mrinmaya Sachan, Ryan Cotterell
2023	A*	`conf`	Enhancing Textbooks with Visuals from the Web for Improved Learning. EMNLP Janvijay Singh, Vilém Zouhar, Mrinmaya Sachan
2023	J	`jnl`	Enhancing Textbooks with Visuals from the Web for Improved Learning. CoRR Janvijay Singh, Vilém Zouhar, Mrinmaya Sachan
2023	J	`jnl`	Evaluating Optimal Reference Translations. CoRR Vilém Zouhar, Vera Kloudová, Martin Popel, Ondrej Bojar
2023	—	`conf`	Findings of the WMT 2023 Shared Task on Machine Translation with Terminologies. WMT Kirill Semenov, Vilém Zouhar, Tom Kocmi, Dongdong Zhang, Wangchunshu Zhou, Yuchen Eleanor Jiang
2023	J	`jnl`	Multimodal Shannon Game with Images. CoRR Vilém Zouhar, Sunit Bhattacharya, Ondrej Bojar
2023	J	`jnl`	PWESuite: Phonetic Word Embeddings and Tasks They Facilitate. CoRR Vilém Zouhar, Kalvin Chang, Chenxuan Cui, Nathaniel Carlson, Nathaniel R. Robinson, Mrinmaya Sachan, David R. Mortensen
2023	A	`conf`	Poor Man's Quality Estimation: Predicting Reference-Based MT Metrics Without the Reference. EACL Vilém Zouhar, Shehzaad Dhuliawala, Wangchunshu Zhou, Nico Daheim, Tom Kocmi, Yuchen Eleanor Jiang, Mrinmaya Sachan
2023	J	`jnl`	Poor Man's Quality Estimation: Predicting Reference-Based MT Metrics Without the Reference. CoRR Vilém Zouhar, Shehzaad Dhuliawala, Wangchunshu Zhou, Nico Daheim, Tom Kocmi, Yuchen Eleanor Jiang, Mrinmaya Sachan
2023	J	`jnl`	RELIC: Investigating Large Language Model Responses using Self-Consistency. CoRR Furui Cheng, Vilém Zouhar, Simran Arora, Mrinmaya Sachan, Hendrik Strobelt, Mennatallah El-Assady
2023	J	`jnl`	Re-visiting Automated Topic Model Evaluation with Large Language Models. CoRR Dominik Stammbach, Vilém Zouhar, Alexander Miserlis Hoyle, Mrinmaya Sachan, Elliott Ash
2023	A*	`conf`	Revisiting Automated Topic Model Evaluation with Large Language Models. EMNLP Dominik Stammbach, Vilém Zouhar, Alexander Miserlis Hoyle, Mrinmaya Sachan, Elliott Ash
2023	—	`conf`	Tokenization and the Noiseless Channel. ACL (1) Vilém Zouhar, Clara Meister, Juan Luis Gastaldi, Li Du, Mrinmaya Sachan, Ryan Cotterell
2023	J	`jnl`	Tokenization and the Noiseless Channel. CoRR Vilém Zouhar, Clara Meister, Juan Luis Gastaldi, Li Du, Mrinmaya Sachan, Ryan Cotterell
2022	J	`jnl`	Artefact Retrieval: Overview of NLP Models with Knowledge Base Access. CoRR Vilém Zouhar, Marius Mosbach, Debanjali Biswas, Dietrich Klakow
2022	J	`jnl`	EMMT: A simultaneous eye-tracking, 4-electrode EEG and audio corpus for multi-modal reading and translation scenarios. CoRR Sunit Bhattacharya, Vera Kloudová, Vilém Zouhar, Ondrej Bojar
2022	J	`jnl`	Fusing Sentence Embeddings Into LSTM-based Autoregressive Language Models. CoRR Vilém Zouhar, Marius Mosbach, Dietrich Klakow
2022	J	`jnl`	Knowledge Base Index Compression via Dimensionality and Precision Reduction. CoRR Vilém Zouhar, Marius Mosbach, Miaoran Zhang, Dietrich Klakow
2022	—	`conf`	Sentence Ambiguity, Grammaticality and Complexity Probes. BlackboxNLP@EMNLP Sunit Bhattacharya, Vilém Zouhar, Ondrej Bojar
2022	J	`jnl`	Sentence Ambiguity, Grammaticality and Complexity Probes. CoRR Sunit Bhattacharya, Vilém Zouhar, Ondrej Bojar
2021	—	`conf`	Backtranslation Feedback Improves User Confidence in MT, Not Quality. NAACL-HLT Vilém Zouhar, Michal Novák, Matús Zilinec, Ondrej Bojar, Mateo Obregón, Robin L. Hill, Frédéric Blain, Marina Fomicheva, Lucia Specia, Lisa Yankovskaya
2021	J	`jnl`	Backtranslation Feedback Improves User Confidence in MT, Not Quality. CoRR Vilém Zouhar, Michal Novák, Matús Zilinec, Ondrej Bojar, Mateo Obregón, Robin L. Hill, Frédéric Blain, Marina Fomicheva, Lucia Specia, Lisa Yankovskaya
2021	J	`jnl`	Leveraging Neural Machine Translation for Word Alignment. CoRR Vilém Zouhar, Daria Pylypenko
2021	J	`jnl`	Leveraging Neural Machine Translation for Word Alignment. Prague Bull. Math. Linguistics Vilém Zouhar, Daria Pylypenko
2021	—	`conf`	Neural Machine Translation Quality and Post-Editing Performance. EMNLP (1) Vilém Zouhar, Martin Popel, Ondrej Bojar, Ales Tamchyna
2021	J	`jnl`	Neural Machine Translation Quality and Post-Editing Performance. CoRR Vilém Zouhar, Ales Tamchyna, Martin Popel, Ondrej Bojar
2021	—	`conf`	Sampling and Filtering of Neural Machine Translation Distillation Data. NAACL-HLT (Student Research Workshop) Vilém Zouhar
2021	J	`jnl`	Sampling and Filtering of Neural Machine Translation Distillation Data. CoRR Vilém Zouhar
2020	J	`jnl`	Extending Ptakopět for Machine Translation User Interaction Experiments. Prague Bull. Math. Linguistics Vilém Zouhar, Michal Novák
2020	B	`conf`	Outbound Translation User Interface Ptakopet: A Pilot Study. LREC Vilém Zouhar, Ondrej Bojar
2020	—	`conf`	WMT20 Document-Level Markable Error Exploration. WMT@EMNLP Vilém Zouhar, Tereza Vojtechová, Ondrej Bojar
2019	J	`jnl`	Outbound Translation User Interface Ptakopet: A Pilot Study. CoRR Vilém Zouhar, Ondrej Bojar