Constructing Hard-Positive Query–Document Pairs for Dense Retrieval via Phrase Representativeness
This work defines model-specific Token and Phrase Representativeness Scores (TRS/PRS) to discover tokens and key phrases that appear in a document but are poorly expressed by its embedding, which improve retrieval on a constructed hard-positive benchmark and can also improve standard in-domain retrieval benchmarks.