Effective Re-Ranking with DIMEs using Few Noisy LLM-Generated Relevance Judgments
New approaches based on the recently proposed Dimension IMportance Estimators (DIMEs) are introduced, incorporating LLM-generated relevance judgments into the re-ranking process, showing that even a few noisy relevance judgments from small LLMs can provide a powerful signal to improve the effectiveness of IR systems.