Nandan Thakur - RankMe

44 papers A* 5Misc 1Journal 28Unranked 10

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Overview of the TREC 2025 Retrieval Augmented Generation (RAG) Track. CoRR Shivani Upadhyay, Nandan Thakur, Ronak Pradeep, Nick Craswell, Daniel Campos, Jimmy Lin
2026	J	`jnl`	Still Fresh? Evaluating Temporal Drift in Retrieval Benchmarks. CoRR Nathan Kuissi, Suraj Subrahmanyan, Nandan Thakur, Jimmy Lin
2025	Misc	`conf`	A Large-Scale Study of Relevance Assessments with Large Language Models Using UMBRELA. ICTIR Shivani Upadhyay, Ronak Pradeep, Nandan Thakur, Daniel Campos, Nick Craswell, Ian Soboroff, Jimmy Lin
2025	A*	`conf`	Assessing Support for the TREC 2024 RAG Track: A Large-Scale Comparative Study of LLM and Human Evaluations. SIGIR Nandan Thakur, Ronak Pradeep, Shivani Upadhyay, Daniel Campos, Nick Craswell, Ian Soboroff, Hoa Trang Dang, Jimmy Lin
2025	J	`jnl`	BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent. CoRR Zijian Chen, Xueguang Ma, Shengyao Zhuang, Ping Nie, Kai Zou, Andrew Liu, Joshua Green, Kshama Patel, Ruoxi Meng, Mingyi Su, Sahel Sharifymoghaddam, Yanxi Li, Haoran Hong, Xinyu Shi, Xuye Liu, Nandan Thakur, Crystina Zhang, Luyu Gao, Wenhu Chen, Jimmy Lin
2025	J	`jnl`	Chatbot Arena Meets Nuggets: Towards Explanations and Diagnostics in the Evaluation of LLM Responses. CoRR Sahel Sharifymoghaddam, Shivani Upadhyay, Nandan Thakur, Ronak Pradeep, Jimmy Lin
2025	J	`jnl`	Fixing Data That Hurts Performance: Cascading LLMs to Relabel Hard Negatives for Robust Information Retrieval. CoRR Nandan Thakur, Crystina Zhang, Xueguang Ma, Jimmy Lin
2025	J	`jnl`	FreshStack: Building Realistic Benchmarks for Evaluating Retrieval on Technical Documents. CoRR Nandan Thakur, Jimmy Lin, Sam Havens, Michael Carbin, Omar Khattab, Andrew Drozdov
2025	—	`conf`	Hard Negatives, Hard Lessons: Revisiting Training Data Quality for Robust Information Retrieval with LLMs. EMNLP (Findings) Nandan Thakur, Crystina Zhang, Xueguang Ma, Jimmy Lin
2025	—	`conf`	MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems. NAACL (Long Papers) Nandan Thakur, Suleman Kazi, Ge Luo, Jimmy Lin, Amin Ahmad
2025	J	`jnl`	MMTEB: Massive Multilingual Text Embedding Benchmark. CoRR Kenneth C. Enevoldsen, Isaac Chung, Imene Kerboua, Márton Kardos, Ashwin Mathur, David Stap, Jay Gala, Wissam Siblini, Dominik Krzeminski, Genta Indra Winata, Saba Sturua, Saiteja Utpala, Mathieu Ciancone, Marion Schaeffer, Gabriel Sequeira, Diganta Misra, Shreeya Dhakal, Jonathan Rystrøm, Roman Solomatin, Ömer Çagatan, Akash Kundu, Martin Bernstorff, Shitao Xiao, Akshita Sukhlecha, Bhavish Pahwa, Rafal Poswiata, Kranthi Kiran GV, Shawon Ashraf, Daniel Auras, Björn Plüster, Jan Philipp Harries, Loïc Magne, Isabelle Mohr, Mariya Hendriksen, Dawei Zhu, Hippolyte Gisserot-Boukhlef, Tom Aarsen, Jan Kostkan, Konrad Wojtasik, Taemin Lee, Marek Suppa, Crystina Zhang, Roberta Rocca, Mohammed Hamdy, Andrianos Michail, John Yang, Manuel Faysse, Aleksei Vatolin, Nandan Thakur, Manan Dey, Dipam Vasani, Pranjal A. Chitale, Simone Tedeschi, Nguyen Tai, Artem Snegirev, Michael Günther, Mengzhou Xia, Weijia Shi, Xing Han Lù, Jordan Clive, Gayatri Krishnakumar, Anna Maksimova, Silvan Wehrli, Maria Tikhonova, Henil Panchal, Aleksandr Abramov, Malte Ostendorff, Zheng Liu, Simon Clematide, Lester James V. Miranda, Alena Fenogenova, Guangyu Song, Ruqiya Bin Safi, Wen-Ding Li, Alessia Borghini, Federico Cassano, Hongjin Su, Jimmy Lin, Howard Yen, Lasse Hansen, Sara Hooker, Chenghao Xiao, Vaibhav Adlakha, Orion Weller, Siva Reddy, Niklas Muennighoff
2025	—	`conf`	Ragnarök: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track. ECIR (1) Ronak Pradeep, Nandan Thakur, Sahel Sharifymoghaddam, Eric Zhang, Ryan Nguyen, Daniel Campos, Nick Craswell, Jimmy Lin
2025	J	`jnl`	Support Evaluation for the TREC 2024 RAG Track: Comparing Human versus LLM Judges. CoRR Nandan Thakur, Ronak Pradeep, Shivani Upadhyay, Daniel Campos, Nick Craswell, Jimmy Lin
2025	A*	`conf`	The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models. SIGIR Ronak Pradeep, Nandan Thakur, Shivani Upadhyay, Daniel Campos, Nick Craswell, Ian Soboroff, Hoa Trang Dang, Jimmy Lin
2025	J	`jnl`	The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models. CoRR Ronak Pradeep, Nandan Thakur, Shivani Upadhyay, Daniel Campos, Nick Craswell, Jimmy Lin
2024	—	`conf`	"Knowing When You Don't Know": A Multilingual Relevance Assessment Dataset for Robust Retrieval-Augmented Generation. EMNLP (Findings) Nandan Thakur, Luiz Bonifacio, Xinyu Zhang, Odunayo Ogundepo, Ehsan Kamalloo, David Alfonso-Hermelo, Xiaoguang Li, Qun Liu, Boxing Chen, Mehdi Rezagholizadeh, Jimmy Lin
2024	J	`jnl`	A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look. CoRR Shivani Upadhyay, Ronak Pradeep, Nandan Thakur, Daniel Campos, Nick Craswell, Ian Soboroff, Hoa Trang Dang, Jimmy Lin
2024	J	`jnl`	Initial Nugget Evaluation Results for the TREC 2024 RAG Track with the AutoNuggetizer Framework. CoRR Ronak Pradeep, Nandan Thakur, Shivani Upadhyay, Daniel Campos, Nick Craswell, Jimmy Lin
2024	—	`conf`	Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrieval. NAACL-HLT Nandan Thakur, Jianmo Ni, Gustavo Hernández Ábrego, John Wieting, Jimmy Lin, Daniel Cer
2024	J	`jnl`	MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems. CoRR Nandan Thakur, Suleman Kazi, Ge Luo, Jimmy Lin, Amin Ahmad
2024	J	`jnl`	Ragnarök: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track. CoRR Ronak Pradeep, Nandan Thakur, Sahel Sharifymoghaddam, Eric Zhang, Ryan Nguyen, Daniel Campos, Nick Craswell, Jimmy Lin
2024	A*	`conf`	Resources for Brewing BEIR: Reproducible Reference Models and Statistical Analyses. SIGIR Ehsan Kamalloo, Nandan Thakur, Carlos Lassance, Xueguang Ma, Jheng-Hong Yang, Jimmy Lin
2024	A*	`conf`	Systematic Evaluation of Neural Retrieval Models on the Touché 2020 Argument Retrieval Subset of BEIR. SIGIR Nandan Thakur, Luiz Bonifacio, Maik Fröbe, Alexander Bondarenko, Ehsan Kamalloo, Martin Potthast, Matthias Hagen, Jimmy Lin
2024	J	`jnl`	Systematic Evaluation of Neural Retrieval Models on the Touché 2020 Argument Retrieval Subset of BEIR. CoRR Nandan Thakur, Luiz Bonifacio, Maik Fröbe, Alexander Bondarenko, Ehsan Kamalloo, Martin Potthast, Matthias Hagen, Jimmy Lin
2024	J	`jnl`	UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor. CoRR Shivani Upadhyay, Ronak Pradeep, Nandan Thakur, Nick Craswell, Jimmy Lin
2023	—	`conf`	Evaluating Embedding APIs for Information Retrieval. ACL (industry) Ehsan Kamalloo, Xinyu Zhang, Odunayo Ogundepo, Nandan Thakur, David Alfonso-Hermelo, Mehdi Rezagholizadeh, Jimmy Lin
2023	J	`jnl`	Evaluating Embedding APIs for Information Retrieval. CoRR Ehsan Kamalloo, Xinyu Zhang, Odunayo Ogundepo, Nandan Thakur, David Alfonso-Hermelo, Mehdi Rezagholizadeh, Jimmy Lin
2023	J	`jnl`	HAGRID: A Human-LLM Collaborative Dataset for Generative Information-Seeking with Attribution. CoRR Ehsan Kamalloo, Aref Jafari, Xinyu Zhang, Nandan Thakur, Jimmy Lin
2023	J	`jnl`	Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrieval. CoRR Nandan Thakur, Jianmo Ni, Gustavo Hernández Ábrego, John Wieting, Jimmy Lin, Daniel Cer
2023	J	`jnl`	MIRACL: A Multilingual Retrieval Dataset Covering 18 Diverse Languages. Trans. Assoc. Comput. Linguistics Xinyu Zhang, Nandan Thakur, Odunayo Ogundepo, Ehsan Kamalloo, David Alfonso-Hermelo, Xiaoguang Li, Qun Liu, Mehdi Rezagholizadeh, Jimmy Lin
2023	J	`jnl`	NoMIRACL: Knowing When You Don't Know for Robust Multilingual Retrieval-Augmented Generation. CoRR Nandan Thakur, Luiz Bonifacio, Xinyu Zhang, Odunayo Ogundepo, Ehsan Kamalloo, David Alfonso-Hermelo, Xiaoguang Li, Qun Liu, Boxing Chen, Mehdi Rezagholizadeh, Jimmy Lin
2023	J	`jnl`	Resources for Brewing BEIR: Reproducible Reference Models and an Official Leaderboard. CoRR Ehsan Kamalloo, Nandan Thakur, Carlos Lassance, Xueguang Ma, Jheng-Hong Yang, Jimmy Lin
2023	A*	`conf`	SPRINT: A Unified Toolkit for Evaluating and Demystifying Zero-shot Neural Sparse Retrieval. SIGIR Nandan Thakur, Kexin Wang, Iryna Gurevych, Jimmy Lin
2023	J	`jnl`	SPRINT: A Unified Toolkit for Evaluating and Demystifying Zero-shot Neural Sparse Retrieval. CoRR Nandan Thakur, Kexin Wang, Iryna Gurevych, Jimmy Lin
2023	J	`jnl`	Simple Yet Effective Neural Ranking and Reranking Baselines for Cross-Lingual Information Retrieval. CoRR Jimmy Lin, David Alfonso-Hermelo, Vitor Jeronymo, Ehsan Kamalloo, Carlos Lassance, Rodrigo Nogueira, Odunayo Ogundepo, Mehdi Rezagholizadeh, Nandan Thakur, Jheng-Hong Yang, Xinyu Zhang
2022	J	`jnl`	Domain Adaptation for Memory-Efficient Dense Retrieval. CoRR Nandan Thakur, Nils Reimers, Jimmy Lin
2022	—	`conf`	GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval. NAACL-HLT Kexin Wang, Nandan Thakur, Nils Reimers, Iryna Gurevych
2022	J	`jnl`	Making a MIRACL: Multilingual Information Retrieval Across a Continuum of Languages. CoRR Xinyu Zhang, Nandan Thakur, Odunayo Ogundepo, Ehsan Kamalloo, David Alfonso-Hermelo, Xiaoguang Li, Qun Liu, Mehdi Rezagholizadeh, Jimmy Lin
2022	—	`conf`	Simple Yet Effective Neural Ranking and Reranking Baselines for Cross-Lingual Information Retrieval. TREC Jimmy Lin, David Alfonso-Hermelo, Vitor Jeronymo, Ehsan Kamalloo, Carlos Lassance, Rodrigo Nogueira, Odunayo Ogundepo, Mehdi Rezagholizadeh, Nandan Thakur, Jheng-Hong Yang, Xinyu Zhang
2021	—	`conf`	Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring Tasks. NAACL-HLT Nandan Thakur, Nils Reimers, Johannes Daxenberger, Iryna Gurevych
2021	—	`conf`	BEIR: A Heterogeneous Benchmark for Zero-shot Evaluation of Information Retrieval Models. NeurIPS Datasets and Benchmarks Nandan Thakur, Nils Reimers, Andreas Rücklé, Abhishek Srivastava, Iryna Gurevych
2021	J	`jnl`	BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models. CoRR Nandan Thakur, Nils Reimers, Andreas Rücklé, Abhishek Srivastava, Iryna Gurevych
2021	J	`jnl`	GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval. CoRR Kexin Wang, Nandan Thakur, Nils Reimers, Iryna Gurevych
2020	J	`jnl`	Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring Tasks. CoRR Nandan Thakur, Nils Reimers, Johannes Daxenberger, Iryna Gurevych