Skip to content
Book Open access

Graph-Enhanced Sentence Retrieval for Multi-Document Summarization in Low-Resource Languages

Jul 2026 · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval · 0 citations · 37 references
Computer Science

TL;DR

This approach combines language-adaptive mixture-of-experts embeddings with graph neural networks that model discourse structure, addressing linguistic challenges across typologically diverse low-resource languages.

Abstract

Multi-document summarization for low-resource languages faces a critical trade-off: large language models are computationally prohibitive for most institutions, while smaller models suffer from severe hallucination in abstractive generation. We address this through extractive sentence retrieval, which guarantees faithfulness while operating within constrained computational budgets. Our approach combines language-adaptive mixture-of-experts embeddings with graph neural networks that model discourse structure, addressing linguistic challenges across typologically diverse low-resource languages. With only 3.2M trainable parameters, our model requires 28 times less training time than comparable transformer-based approaches, making it practical for single-GPU environments typical in resource-limited settings. We demonstrate applicability to some main Southeast Asia (SEA) countries including Vietnam, Thailand, Laos, Indonesia, and Malaysia, representing three distinct language families: Austroasiatic, Kra-Dai, and Austronesian.

Read PDF

Similar papers

Preprint Aug 2026

BM25-Augmented Many-Shot Translation for Low-Resource North-Eastern Indian Languages

The retrieval-augmented many-shot translation pipeline from the AmericasNLP 2026 system is adapted to translate between English and eleven North-Eastern Indian languages in both directions to solve the WMT26 Low-Resource Indic Language Translation shared task.

Aashish Dhawan, Christopher Driggers-Ellis, Dzmitry Kasinets et al. · 0 citations
Open access Jul 2026

Enhancing Readability of Telugu Text Summarization Using Multi-scale Attention and Bio-inspired Optimization

The proposed MLOA-MA-ASeqNet architecture, a Multi-scale Attention and Adaptive Sequence-to-Sequence Network whose hierarchical encoder operates simultaneously at word, phrase and sentence level granularity, achieves the highest average score across fluency, adequacy, coherence and readability.

V. M, Kunal Chakma, Anupam Jamatia et al. · 0 citations
Open access Aug 2026

Neural Turing Machines for efficient natural language summarization: architecture, optimization, and performance analysis

Abstractive text summarization remains a fundamental challenge in Natural Language Processing (NLP), particularly for long documents that require models to preserve long-range dependencies and maintain semantic coherence. Although Transformer-based architectures have achieved strong summarization performance, their full self-attention mechanism scales quadratically with sequence length and often requires input truncation in long-context applications. This study presents a Neural Turing Machine (NTM)-based framework for abstractive text summarization. The proposed architecture combines a two-layer Bidirectional Long Short-Term Memory (BiLSTM) controller with an addressable external memory bank. Differentiable read and write operations decouple contextual storage from recurrent computation, enabling the persistent retrieval of salient information across extended input sequences. Detailed preprocessing, implementation, training, decoding, and evaluation settings are provided to support reproducibility. The framework was evaluated on the CNN/Daily Mail benchmark and compared with LSTM, Transformer, and BART baselines, as well as published high-performing systems, including PEGASUS, SimCLS, and BRIO. Ablation studies, learning-rate sensitivity analysis, long-context evaluation, inference-time scaling, statistical testing, qualitative error analysis, and memory-access visualization were also conducted. The proposed NTM model achieved ROUGE-1, ROUGE-2, ROUGE-L, and BLEU scores of 47.8, 23.5, 44.6, and 20.1, respectively. Under the controlled experimental protocol, it outperformed the evaluated LSTM, Transformer, and BART baselines. Comparisons with published results indicate that the model is competitive with recent high-performing summarization systems. The additional analyses demonstrate that the external memory mechanism improves contextual retention and summarization stability, particularly for longer input sequences, while exhibiting favorable inference-time scaling behavior. These findings demonstrate that integrating an addressable external memory with a BiLSTM controller offers an effective approach to abstractive summarization, particularly when processing long documents. The proposed framework provides competitive summarization performance while reducing dependence on computationally expensive full self-attention. The results highlight the potential of external-memory architectures as a scalable and stable alternative for long-context text summarization.

K. Katti, Kartikeya Reddy Katti, Amanul Islam · 0 citations
Preprint Aug 2026

VoxSumm: A Multilingual Corpus of Long-Form Spoken News for Joint Summarization and Translation

This work formalizes joint speech summarization and translation (JSumT), the generation of a succinct, faithful target-language summary directly from a long spoken document in a source language, and establishes a foundation for developing and evaluating multilingual systems capable of jointly interpreting, compressing, and translating long-form speech.

Yejin Jeon, Marie Maltais, Virginia Ceccatelli et al. · 0 citations
Preprint Aug 2026

Efficient Multilingual Neural Machine Translation via Corpus-Driven Vocabulary Pruning: An English-Arabic Case Study

This paper proposes a general optimization framework that combines a vocabulary pruning method with a targeted fine-tuning protocol for MNMT models, and reduces the vocabulary size from over 128,000 to approximately 10,000 tokens, enabling a 60% memory saving without any loss in performance.

Ahmed Amine Aliane, N. Semmar, H. Aliane · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.