RAG Retrieval Drops 40 Points as Distractor Passages Reach 2.68M

Written by

in

A reproducible RAG retrieval test shows that retrieval performance drops by 40 points when the number of distractor passages grows to 2.68M. The author compares BM25, embedding retrieval, and parent-document approaches, and analyzes why an answer’s position in the context affects the results. The article argues that hand-written evaluations tend to overestimate search performance.

Source:Towards Data Science · Read Original

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *