OpenRAG: Optimizing RAG End-to-End via In-Context Retrieval Learning

Jiawei Zhou, Lei Chen
3/11/2025
cs.CLcs.IR

No confident code implementation found for this paper. 3 possible matches can be shown below.

Abstract

In this paper, we analyze and empirically show that the learned relevance for conventional information retrieval (IR) scenarios may be inconsistent in retrieval-augmented generation (RAG) scenarios. To bridge this gap, we introduce OpenRAG, a RAG framework that is optimized end-to-end by tuning the retriever to capture in-context relevance, enabling adaptation to the diverse and evolving needs. Extensive experiments across a wide range of tasks demonstrate that OpenRAG, by tuning a retriever end-to-end, leads to a consistent improvement of 4.0% over the original retriever, consistently outperforming existing state-of-the-art retrievers by 2.1%. Additionally, our results indicate that for some tasks, an end-to-end tuned 0.2B retriever can achieve improvements that surpass those of RAG-oriented or instruction-tuned 8B large language models (LLMs), highlighting the cost-effectiveness of our approach in enhancing RAG systems.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 3 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

FedRAG: A Framework for Fine-Tuning Retrieval-Augmented Generation Systems

88% match1 repo1502025

FunnelRAG: A Coarse-to-Fine Progressive Retrieval Paradigm for RAG

87% match2024

XRAG: eXamining the Core -- Benchmarking Foundational Components in Advanced Retrieval-Augmented Generation

87% match1 repo8032024

Multi-task retriever fine-tuning for domain-specific and efficient RAG

86% match2025

Open-RAG: Enhanced Retrieval-Augmented Reasoning with Open-Source Large Language Models

86% match1 repo1472024

Enhancing Retrieval-Augmented Generation: A Study of Best Practices

86% match1 repo1072025

Cite this paper

@article{zhou2025openrag,
  title  = {OpenRAG: Optimizing RAG End-to-End via In-Context Retrieval Learning},
  author = {Jiawei Zhou and Lei Chen},
  year   = {2025},
  eprint = {2503.08398},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2503.08398v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2503.08398.svg)](https://codeofpaper.com/paper/2503.08398)

Discussion