Chi-kiu Lo - RankMe

55 papers A* 2A 1B 5C 2Journal 4Unranked 41

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Improving Methodologies for LLM Evaluations Across Global Languages. CoRR Akriti Vij, Benjamin Chua, Darshini Ramiah, En Qi Ng, Mahran Morsidi, Naga Nikshith Gangarapu, Sharmini Johnson, Vanessa Wilfred, Vikneswaran Kumaran, Wan Sie Lee, Wenzhuo Yang, Yongsen Zheng, Bill Black, Boming Xia, Frank Sun, Hao Zhang, Qinghua Lu, Suyu Ma, Yue Liu, Chi-kiu Lo, Fatemeh Azadi, Isar Nejadgholi, Sowmya Vajjala, Agnès Delaborde, Nicolas Rolin, Tom Seimandi, Akiko Murakami, Haruto Ishi, Satoshi Sekine, Takayuki Semitsu, Tasuku Sasaki, Angela Kinuthia, Jean Wangari, Michael Michie, Stephanie Kasaon, Hankyul Baek, Jaewon Noh, Kihyuk Nam, Sang Seo, Sungpil Shin, Taewhi Lee, Yongsu Kim, Daisy Newbold-Harrop, Jessica Wang, Mahmoud Ghanem, Vy Hong
2025	—	`conf`	Challenges in Technical Regulatory Text Variation Detection. COLING Workshops Shriya Vaagdevi Chikati, Samuel Larkin, David Minicola, Chi-kiu Lo
2025	J	`jnl`	Gender-Neutral Machine Translation Strategies in Practice. CoRR Hillary Dawkins, Isar Nejadgholi, Chi-kiu Lo
2024	—	`conf`	Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task. WMT Markus Freitag, Nitika Mathur, Daniel Deutsch, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Frédéric Blain, Tom Kocmi, Jiayi Wang, David Ifeoluwa Adelani, Marianna Buchicchio, Chrysoula Zerva, Alon Lavie
2024	—	`conf`	Evaluation Briefs: Drawing on Translation Studies for Human Evaluation of MT. AMTA (1) Ting Liu, Chi-kiu Lo, Elizabeth Marshman, Rebecca Knowles
2024	—	`conf`	MSLC24: Further Challenges for Metrics on a Wide Landscape of Translation Quality. WMT Rebecca Knowles, Samuel Larkin, Chi-kiu Lo
2024	—	`conf`	Some Tradeoffs in Continual Learning for Parliamentary Neural Machine Translation Systems. AMTA (1) Rebecca Knowles, Samuel Larkin, Michel Simard, Marc Tessier, Gabriel Bernier-Colborne, Cyril Goutte, Chi-kiu Lo
2024	—	`conf`	WMT24 Test Suite: Gender Resolution in Speaker-Listener Dialogue Roles. WMT Hillary Dawkins, Isar Nejadgholi, Chi-kiu Lo
2024	J	`jnl`	WMT24 Test Suite: Gender Resolution in Speaker-Listener Dialogue Roles. CoRR Hillary Dawkins, Isar Nejadgholi, Chi-kiu Lo
2023	—	`conf`	Data Sampling and (In)stability in Machine Translation Evaluation. ACL (Findings) Chi-kiu Lo, Rebecca Knowles
2023	—	`conf`	Metric Score Landscape Challenge (MSLC23): Understanding Metrics' Performance on a Wider Landscape of Translation Quality. WMT Chi-kiu Lo, Samuel Larkin, Rebecca Knowles
2023	—	`conf`	Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent. WMT Markus Freitag, Nitika Mathur, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Tom Kocmi, Frédéric Blain, Daniel Deutsch, Craig Stewart, Chrysoula Zerva, Sheila Castilho, Alon Lavie, George F. Foster
2022	—	`conf`	Results of WMT22 Metrics Shared Task: Stop Using BLEU - Neural Metrics Are Better and More Robust. WMT Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, Eleftherios Avramidis, Tom Kocmi, George F. Foster, Alon Lavie, André F. T. Martins
2022	—	`conf`	Test Set Sampling Affects System Rankings: Expanded Human Evaluation of WMT20 English-Inuktitut Systems. WMT Rebecca Knowles, Chi-kiu Lo
2021	—	`conf`	Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain. WMT@EMNLP Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, George F. Foster, Alon Lavie, Ondrej Bojar
2020	—	`conf`	Extended Study on Using Pretrained Language Models and YiSi-1 for Machine Translation Evaluation. WMT@EMNLP Chi-kiu Lo
2020	—	`conf`	Findings of the 2020 Conference on Machine Translation (WMT20). WMT@EMNLP Loïc Barrault, Magdalena Biesialska, Ondrej Bojar, Marta R. Costa-jussà, Christian Federmann, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Matthias Huck, Eric Joanis, Tom Kocmi, Philipp Koehn, Chi-kiu Lo, Nikola Ljubesic, Christof Monz, Makoto Morishita, Masaaki Nagata, Toshiaki Nakazawa, Santanu Pal, Matt Post, Marcos Zampieri
2020	—	`conf`	Improving Parallel Data Identification using Iteratively Refined Sentence Alignments and Bilingual Mappings of Pre-trained Language Models. WMT@EMNLP Chi-kiu Lo, Eric Joanis
2020	—	`conf`	Machine Translation Reference-less Evaluation using YiSi-2 with Bilingual Mappings of Massive Multilingual Language Model. WMT@EMNLP Chi-kiu Lo, Samuel Larkin
2020	J	`jnl`	Neural Polysynthetic Language Modelling. CoRR Lane Schwartz, Francis M. Tyers, Lori S. Levin, Christo Kirov, Patrick Littell, Chi-kiu Lo, Emily Prud'hommeaux, Hyunji Hayley Park, Kenneth Steimel, Rebecca Knowles, Jeffrey Micher, Lonny Strunk, Han Liu, Coleman Haley, Katherine J. Zhang, Robbie Jimerson, Vasilisa Andriyanets, Aldrian Obaja Muis, Naoki Otani, Jong Hyuk (Jay) Park, Zhisong Zhang
2020	B	`conf`	The Nunavut Hansard Inuktitut-English Parallel Corpus 3.0 with Preliminary Machine Translation Results. LREC Eric Joanis, Rebecca Knowles, Roland Kuhn, Samuel Larkin, Patrick Littell, Chi-kiu Lo, Darlene A. Stewart, Jeffrey Micher
2019	B	`conf`	Fully Unsupervised Crosslingual Semantic Textual Similarity Metric Based on BERT for Identifying Parallel Data. CoNLL Chi-kiu Lo, Michel Simard
2019	—	`conf`	Multi-Source Transformer for Kazakh-Russian-English Neural Machine Translation. WMT (2) Patrick Littell, Chi-kiu Lo, Samuel Larkin, Darlene A. Stewart
2019	—	`conf`	NRC Parallel Corpus Filtering System for WMT 2019. WMT (3) Gabriel Bernier-Colborne, Chi-kiu Lo
2019	—	`conf`	YiSi - a Unified Semantic MT Quality Evaluation and Estimation Metric for Languages with Different Levels of Available Resources. WMT (2) Chi-kiu Lo
2018	—	`conf`	Accurate semantic textual similarity for cleaning noisy parallel corpora using semantic machine translation evaluation metric: The NRC supervised submissions to the Parallel Corpus Filtering task. WMT (shared task) Chi-kiu Lo, Michel Simard, Darlene A. Stewart, Samuel Larkin, Cyril Goutte, Patrick Littell
2018	—	`conf`	Measuring sentence parallelism using Mahalanobis distances: The NRC unsupervised submissions to the WMT18 Parallel Corpus Filtering shared task. WMT (shared task) Patrick Littell, Samuel Larkin, Darlene A. Stewart, Michel Simard, Cyril Goutte, Chi-kiu Lo
2017	—	`conf`	MEANT 2.0: Accurate semantic MT evaluation for any output language. WMT Chi-kiu Lo
2017	—	`conf`	NRC Machine Translation System for WMT 2017. WMT Chi-kiu Lo, Boxing Chen, Colin Cherry, George F. Foster, Samuel Larkin, Darlene A. Stewart, Roland Kuhn
2016	—	`conf`	CNRC at SemEval-2016 Task 1: Experiments in Crosslingual Semantic Textual Similarity. SemEval@NAACL-HLT Chi-kiu Lo, Cyril Goutte, Michel Simard
2016	—	`conf`	NRC Russian-English Machine Translation System for WMT 2016. WMT Chi-kiu Lo, Colin Cherry, George F. Foster, Darlene A. Stewart, Rabib Islam, Anna Kazantseva, Roland Kuhn
2015	—	`conf`	Improving evaluation and optimization of MT systems against MEANT. WMT@EMNLP Chi-kiu Lo, Philipp Dowling, Dekai Wu
2014	—	`conf`	Better Semantic Frame Based MT Evaluation via Inversion Transduction Grammars. SSST@EMNLP Dekai Wu, Chi-kiu Lo, Meriem Beloucif, Markus Saers
2014	—	`conf`	BiMEANT: Integrating Cross-Lingual and Monolingual Semantic Frame Similarities in the MEANT Semantic MT Evaluation Metric. SLSP Chi-kiu Lo, Dekai Wu
2014	—	`conf`	Improving MEANT based semantically tuned SMT. IWSLT (Evaluation Campaign) Meriem Beloucif, Chi-kiu Lo, Dekai Wu
2014	—	`conf`	Lexical Access Preference and Constraint Strategies for Improving Multiword Expression Association within Semantic MT Evaluation. CogALex@COLING Dekai Wu, Chi-kiu Lo, Markus Saers
2014	B	`conf`	On the reliability and inter-annotator agreement of human semantic MT evaluation via HMEANT. LREC Chi-kiu Lo, Dekai Wu
2014	—	`conf`	XMEANT: Better semantic MT evaluation without reference translations. ACL (2) Chi-kiu Lo, Meriem Beloucif, Markus Saers, Dekai Wu
2013	—	`conf`	Can Informal Genres be better Translated by Tuning on Automatic Semantic Metrics? MTSummit Chi-kiu Lo, Dekai Wu
2013	—	`conf`	Human semantic MT evaluation with HMEANT for IWSLT 2013. IWSLT (Evaluation Campaign) Chi-kiu Lo, Dekai Wu
2013	—	`conf`	Improving machine translation by training against an automatic semantic frame based evaluation metric. ACL (2) Chi-kiu Lo, Karteek Addanki, Markus Saers, Dekai Wu
2013	—	`conf`	Improving machine translation into Chinese by tuning against Chinese MEANT. IWSLT (Evaluation Campaign) Chi-kiu Lo, Meriem Beloucif, Dekai Wu
2013	—	`conf`	MEANT at WMT 2013: A Tunable, Accurate yet Inexpensive Semantic Frame Based MT Evaluation Metric. WMT@ACL Chi-kiu Lo, Dekai Wu
2012	C	`conf`	Accuracy and robustness in measuring the lexical similarity of semantic role fillers for automatic semantic MT evaluation. PACLIC Anand Karthik Tumuluru, Chi-kiu Lo, Dekai Wu
2012	—	`conf`	Fully Automatic Semantic MT Evaluation. WMT@NAACL-HLT Chi-kiu Lo, Anand Karthik Tumuluru, Dekai Wu
2012	C	`conf`	LTG vs. ITG Coverage of Cross-Lingual Verb Frame Alternations. EAMT Karteek Addanki, Chi-kiu Lo, Markus Saers, Dekai Wu
2012	—	`conf`	Unsupervised vs. supervised weight estimation for semantic MT evaluation metrics. SSST@ACL Chi-kiu Lo, Dekai Wu
2011	A*	`conf`	MEANT: An inexpensive, high-accuracy, semi-automatic metric for evaluating translation utility based on semantic roles. ACL Chi-kiu Lo, Dekai Wu
2011	B	`conf`	Mining Parallel Documents Using Low Bandwidth and High Precision CLIR from the Heterogeneous Web. IJCNLP Simon Shi, Pascale Fung, Emmanuel Prochasson, Chi-kiu Lo, Dekai Wu
2011	A*	`conf`	SMT Versus AI Redux: How Semantic Frames Evaluate MT More Accurately. IJCAI Chi-kiu Lo, Dekai Wu
2011	A	`conf`	Speech Translation with Grammar Driven Probabilistic Phrasal Bilexica Extraction. INTERSPEECH Markus Saers, Dekai Wu, Chi-kiu Lo, Karteek Addanki
2011	—	`conf`	Structured vs. Flat Semantic Role Representations for Machine Translation Evaluation. SSST@ACL Chi-kiu Lo, Dekai Wu
2010	B	`conf`	Evaluating Machine Translation Utility via Semantic Role Labels. LREC Chi-kiu Lo, Dekai Wu
2010	—	`conf`	Semantic vs. Syntactic vs. N-gram Structure for Machine Translation Evaluation. SSST@COLING Chi-kiu Lo, Dekai Wu
2007	—	`conf`	HKUST statistical machine translation experiments for IWSLT 2007. IWSLT Yihai Shen, Chi-kiu Lo, Marine Carpuat, Dekai Wu