Skip to content
Book Open access

Towards Building a Standard Benchmark for Low-Resource Nepali Information Retrieval

Jul 2026 · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval · pp. 5256-5258 · 2 citations · 28 references
Computer Science

TL;DR

It is argued that Nepali provides a compelling testbed for studying morphology-aware retrieval, code-mixed query processing, and multilingual embedding transfer.

Abstract

Despite being spoken by over 26 million people, Nepali lacks a standardized Information Retrieval (IR) benchmark, preventing systematic evaluation of retrieval models in this low-resource setting. While progress has been made in several Nepali NLP tasks, no publicly available test collection with queries and relevance judgments exists for ad-hoc retrieval task. We propose the creation of a first standardized Nepali IR benchmark supporting monolingual (Nepali queries \rightarrow Nepali documents), cross-lingual (English queries \rightarrow Nepali documents), and code-mixed (Nepali-English queries \rightarrow Nepali documents) retrieval. We argue that Nepali provides a compelling testbed for studying morphology-aware retrieval, code-mixed query processing, and multilingual embedding transfer.

Read PDF

Similar papers

Preprint Aug 2026

L\"etzCross: A Cross-Lingual Page-Level Benchmark for Multimodal Retrieval over Luxembourgish Documents

This work introduces L\"etzCross, a benchmark for cross-lingual page-level retrieval over Luxembourgish PDF documents, with document pages indexed as images and queries provided in English, French, German, and Luxembourgish, and examines single-language and multilingual fine-tuning.

Omar El Bachyr, Fred Philippy, L. Bernardy et al. · 0 citations
#computer vision Preprint Sep 2026

Evaluating In-Context Learning and Retrieval Strategies for Devanagari Post-OCR Correction

CharBM25 is established as an effective, GPU-free retrieval strategy that matches or exceeds dense retrieval at negligible computational cost, and combining it with a general-purpose LLM of 12B+ parameters delivers reliable, training-free Devanagari post-OCR correction without task-specific fine-tuning.

Abhishek Bhandari, Gaurav Harit · 0 citations
Open access Aug 2026

KoViDoRe: A Benchmark for Korean Visual Document Retrieval

This work introduces KoViDoRe, a benchmark for Korean visual document retrieval, and curates a large-scale training dataset, Ko-VDR Train Public, to support the development of retrieval models tailored to Korean visual documents.

Yongbin Choi, Yongwoo Song, Mujeen Sung · 1 citation
#small language model Open access Oct 2026

RETRIEVAL BEATS FINE-TUNING: ADAPTING A KAZAKH SMALL LANGUAGE MODEL FOR HISTORICAL QUESTION ANSWERING

Large language models (LLMs) have shown a strong ability to solve a wide range of language tasks. However, they became less practical for subject-specific applications, especially when dealing with low-resource languages. This paper shows an example of adaptation of small language models (SLMs) to solve subject-specifi...

G. Askar, A. Mutaikhan, M. Aitkozhayeva et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.