Shivani Upadhyay

17 papers A* 3Misc 1Journal 11Unranked 2
YearRankTypeTitle / Venue / Authors
2026 J jnl
Overview of the TREC 2025 Retrieval Augmented Generation (RAG) Track.
CoRR
Shivani Upadhyay, Nandan Thakur, Ronak Pradeep, Nick Craswell, Daniel Campos, Jimmy Lin
2026 — conf
Understanding Multi-Structured Documents via LLMs'.
ECIR (4)
Shivani Upadhyay, Messiah Ataey, Syed Shariyar Murtaza, Yifan Nie, Anirudh Aggarwal, Jimmy Lin
2025 Misc conf
A Large-Scale Study of Relevance Assessments with Large Language Models Using UMBRELA.
ICTIR
Shivani Upadhyay, Ronak Pradeep, Nandan Thakur, Daniel Campos, Nick Craswell, Ian Soboroff, Jimmy Lin
2025 A* conf
Assessing Support for the TREC 2024 RAG Track: A Large-Scale Comparative Study of LLM and Human Evaluations.
SIGIR
Nandan Thakur, Ronak Pradeep, Shivani Upadhyay, Daniel Campos, Nick Craswell, Ian Soboroff, Hoa Trang Dang, Jimmy Lin
2025 J jnl
Chatbot Arena Meets Nuggets: Towards Explanations and Diagnostics in the Evaluation of LLM Responses.
CoRR
Sahel Sharifymoghaddam, Shivani Upadhyay, Nandan Thakur, Ronak Pradeep, Jimmy Lin
2025 J jnl
On the Comprehensibility of Multi-structured Financial Documents using LLMs and Pre-processing Tools.
CoRR
Shivani Upadhyay, Messiah Ataey, Shariyar Murtuza, Yifan Nie, Jimmy Lin
2025 J jnl
Support Evaluation for the TREC 2024 RAG Track: Comparing Human versus LLM Judges.
CoRR
Nandan Thakur, Ronak Pradeep, Shivani Upadhyay, Daniel Campos, Nick Craswell, Jimmy Lin
2025 A* conf
The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models.
SIGIR
Ronak Pradeep, Nandan Thakur, Shivani Upadhyay, Daniel Campos, Nick Craswell, Ian Soboroff, Hoa Trang Dang, Jimmy Lin
2025 J jnl
The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models.
CoRR
Ronak Pradeep, Nandan Thakur, Shivani Upadhyay, Daniel Campos, Nick Craswell, Jimmy Lin
2025 — conf
UniRAG: Universal Retrieval Augmentation for Large Vision Language Models.
NAACL (Findings)
Sahel Sharifymoghaddam, Shivani Upadhyay, Wenhu Chen, Jimmy Lin
2024 J jnl
A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look.
CoRR
Shivani Upadhyay, Ronak Pradeep, Nandan Thakur, Daniel Campos, Nick Craswell, Ian Soboroff, Hoa Trang Dang, Jimmy Lin
2024 J jnl
Initial Nugget Evaluation Results for the TREC 2024 RAG Track with the AutoNuggetizer Framework.
CoRR
Ronak Pradeep, Nandan Thakur, Shivani Upadhyay, Daniel Campos, Nick Craswell, Jimmy Lin
2024 J jnl
LLMs Can Patch Up Missing Relevance Judgments in Evaluation.
CoRR
Shivani Upadhyay, Ehsan Kamalloo, Jimmy Lin
2024 A* conf
Towards Robust QA Evaluation via Open LLMs.
SIGIR
Ehsan Kamalloo, Shivani Upadhyay, Jimmy Lin
2024 J jnl
UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor.
CoRR
Shivani Upadhyay, Ronak Pradeep, Nandan Thakur, Nick Craswell, Jimmy Lin
2024 J jnl
UniRAG: Universal Retrieval Augmentation for Multi-Modal Large Language Models.
CoRR
Sahel Sharifymoghaddam, Shivani Upadhyay, Wenhu Chen, Jimmy Lin
2023 J jnl
Regenerating vital facial keypoints for impostor identification from disguised images using CNN.
Expert Syst. Appl.
Jay Mehta, Shreya Talati, Shivani Upadhyay, Sharada Ramakrishna Valiveti, Gaurang Raval