Nitika Mathur

18 papers A* 2Misc 1Journal 3Unranked 11
YearRankTypeTitle / Venue / Authors
2025 — conf
Taming the Real-world Complexities in CPT E/M Coding with Large Language Models.
EMNLP (Industry Track)
Islam Nassar, Yang Lin, Yuan Jin, Rongxin Zhu, Chang Wei Tan, Zenan Zhai, Nitika Mathur, Thanh Tien Vu, Xu Zhong, Long Duong, Yuan-Fang Li
2025 J jnl
Taming the Real-world Complexities in CPT E/M Coding with Large Language Models.
CoRR
Islam Nassar, Xiang-Yang Li, Yuan Jin, Rongxin Zhu, Chang Wei Tan, Zenan Zhai, Nitika Mathur, Thanh Tien Vu, Xu Zhong, Long Duong, Yuan-Fang Li
2024 — conf
Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task.
WMT
Markus Freitag, Nitika Mathur, Daniel Deutsch, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Frédéric Blain, Tom Kocmi, Jiayi Wang, David Ifeoluwa Adelani, Marianna Buchicchio, Chrysoula Zerva, Alon Lavie
2024 — conf
Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy.
WMT
Brian Thompson, Nitika Mathur, Daniel Deutsch, Huda Khayrallah
2024 J jnl
Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy.
CoRR
Brian Thompson, Nitika Mathur, Daniel Deutsch, Huda Khayrallah
2023 — conf
Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent.
WMT
Markus Freitag, Nitika Mathur, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Tom Kocmi, Frédéric Blain, Daniel Deutsch, Craig Stewart, Chrysoula Zerva, Sheila Castilho, Alon Lavie, George F. Foster
2022 — conf
Results of WMT22 Metrics Shared Task: Stop Using BLEU - Neural Metrics Are Better and More Robust.
WMT
Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, Eleftherios Avramidis, Tom Kocmi, George F. Foster, Alon Lavie, André F. T. Martins
2021 — conf
Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain.
WMT@EMNLP
Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, George F. Foster, Alon Lavie, Ondrej Bojar
2021 — —
Robustness in Machine Translation Evaluation.
Nitika Mathur
2020 — conf
Results of the WMT20 Metrics Shared Task.
WMT@EMNLP
Nitika Mathur, Johnny Wei, Markus Freitag, Qingsong Ma, Ondrej Bojar
2020 A* conf
Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics.
ACL
Nitika Mathur, Timothy Baldwin, Trevor Cohn
2020 J jnl
Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics.
CoRR
Nitika Mathur, Tim Baldwin, Trevor Cohn
2019 — conf
Putting Evaluation in Context: Contextual Embeddings Improve Machine Translation Evaluation.
ACL (1)
Nitika Mathur, Timothy Baldwin, Trevor Cohn
2018 Misc conf
Towards Efficient Machine Translation Evaluation by Modelling Annotators.
ALTA
Nitika Mathur, Timothy Baldwin, Trevor Cohn
2017 A* conf
Sequence Effects in Crowdsourced Annotations.
EMNLP
Nitika Mathur, Timothy Baldwin, Trevor Cohn
2015 — conf
Accurate Evaluation of Segment-level Machine Translation Metrics.
HLT-NAACL
Yvette Graham, Timothy Baldwin, Nitika Mathur
2015 — conf
The Impact of Multiword Expression Compositionality on Machine Translation Evaluation.
MWE@NAACL-HLT
Bahar Salehi, Nitika Mathur, Paul Cook, Timothy Baldwin
2014 — conf
Randomized Significance Tests in Machine Translation.
WMT@ACL
Yvette Graham, Nitika Mathur, Timothy Baldwin