Shinsuke Mori

Analysis of Reasoning-Intensive Retrieval in Japanese

JaReIR is introduced, a Japanese benchmark built from Yahoo! Chiebukuro question-answer pairs and Japanese Wikipedia passages with crowdsourced relevance and answerability judgments and performance generally drops from Easy to Hard across retrieval settings, which shows that Japanese reasoning-intensive retrieval remains challenging.