Skip to content
Open access

Retrieval-Augmented Large Language Model for Institutional Knowledge Management and Decision Assistance in Public Organizations

Jul 2026 · International Journal of Engineering Science and Information Technology · 0 citations · 44 references

TL;DR

It is demonstrated that integrating semantic retrieval with grounded LLM generation can improve knowledge accessibility, transparency, and reliability for AI-assisted decision support in public organizations.

Abstract

The increasing volume and complexity of institutional documents in public organizations create challenges in accessing reliable knowledge for administrative processes and evidence-based decision-making. Conventional knowledge management systems often rely on keyword-based retrieval, while standalone Large Language Models (LLMs) may generate inaccurate responses when processing domain-specific institutional information. This study proposes a domain-specific Retrieval-Augmented Generation (RAG) framework to enhance institutional knowledge management and AI-assisted decision support in public-sector organizations. The framework was developed using a Design Science Research approach with Universitas Malikussaleh as a case study. The proposed architecture integrates institutional knowledge base construction, semantic retrieval, grounded language generation, and source attribution mechanisms. A knowledge base comprising 416 official institutional documents was developed through document preprocessing, semantic chunking, embedding generation, and vector database indexing. The framework was evaluated using 200 institutional queries based on retrieval performance, response quality, explainability, and system efficiency metrics. The results demonstrate effective retrieval capability, achieving Precision@5 of 0.884, Recall@5 of 0.921, and Mean Reciprocal Rank of 0.895. Generated responses achieved 94.6% factual accuracy, 91.8% contextual relevance, and 96.5% source attribution accuracy, while the hallucination rate was reduced to 3.2%. Furthermore, the framework achieved an average response latency of 1.18 seconds, indicating practical feasibility for institutional applications. These findings demonstrate that integrating semantic retrieval with grounded LLM generation can improve knowledge accessibility, transparency, and reliability for AI-assisted decision support in public organizations. The proposed framework provides a practical foundation for trustworthy institutional knowledge services and supports more efficient, explainable, and evidence-based administrative decision-making across diverse institutional contexts

Read PDF

Similar papers

Open access 2025

Large Language Model Integration for Enterprise Knowledge Management Platforms

This study proposes an LLM-powered knowledge management framework that combines Retrieval-Augmented Generation (RAG), semantic embeddings, enterprise-specific language models, and vector databases to transform enterprise data into actionable knowledge.

Farhan Malik, Zara Ahmed · 0 citations
Open access Jul 2026

Agnostic Multi-Source Retrieval-Augmented Generation for Documents and Database Question Answering

This study develops a multi-source Retrieval-Augmented Generation (RAG) based Question Answering (QA) system that automatically integrates heterogeneous knowledge sources through a unified source parameter to enhance knowledge transfer and question answering for organizational support and employee onboarding.

Krisna Dwi Setya Adi, Ivan Michael Siregar · 0 citations
Preprint Aug 2026

W-RAG: Source-Aware Retrieval for Enterprise Document Generation from Heterogeneous Knowledge Bases

W-RAG is proposed, a source-aware retrieval framework that performs ontology-guided retrieval, local ranking within each knowledge base, and source-level weighting to regulate evidence composition to improve document coverage and generation quality.

Hridya Dhulipala, Rajesh Ombase, Michael Wang et al. · 0 citations
Conference Jul 2026

Dynamic Retrieval Augmented Generation for Enterprise Knowledge Intelligence Systems using Large Language Models

To address the difficulty faced by university faculty and students in obtaining useful information from massive campus data, this paper proposes an intelligent campus question-and-answer (Q&A) system based on dynamic retrieval-augmented generation (RAG) technology, using campus administrative knowledge as the data source. The system integrates large language models (LLMs) with domain-specific professional knowledge, leveraging the Campus All-in-One project as a foundation. It constructs a campus knowledge base that includes administrative guides, frequently asked questions, and regulatory documents as an external data corpus. By applying the Infinity database, designed specifically for dynamic RAG applications, and employing prompt engineering, the model’s ability to generate accurate and context-aware answers is enhanced. Through this dynamic RAG-based approach tailored for the education domain, the system provides users with interactive access to a wide range of campus administrative information, helping to resolve common issues, simplify inquiry processes for teachers and students, and reduce the workload of campus management.

Charan Thumma, Abhignan Srivatsava Sribhashyam, Chaitanya Tumma et al. · 0 citations
Open access 2024

Retrieval-Augmented Generation (RAG) Systems for Knowledge Management

Artificial Intelligence (AI) and Large Language Models (LLMs) have significantly transformed knowledge management by enabling intelligent, context-aware, and automated information access. However, standalone LLMs often suffer from limitations such as outdated knowledge, hallucinated responses, lack of domain-specific expertise, and limited transparency, reducing their reliability in enterprise and research applications. Retrieval-Augmented Generation (RAG) has emerged as an effective solution by combining language models with external knowledge retrieval, allowing responses to be generated using up-to-date and relevant information. This study proposes a comprehensive Retrieval-Augmented Generation framework for intelligent knowledge management systems. The framework integrates document acquisition, preprocessing, semantic embedding generation, vector database indexing, document retrieval, prompt augmentation, LLM-based response generation, response validation, and continuous knowledge base updates. It supports diverse knowledge sources, including enterprise databases, technical documents, digital libraries, and research repositories, while incorporating sparse, dense, hybrid retrieval, and neural reranking techniques to improve retrieval accuracy. The proposed framework is evaluated using retrieval precision, recall, F1-score, response relevance, latency, grounding accuracy, and user satisfaction. Results demonstrate improved semantic understanding, reduced hallucinations, enhanced factual correctness, and real-time knowledge updates compared with conventional keyword-based knowledge management systems. The study also discusses future directions, including multimodal RAG, graph-enhanced retrieval, federated knowledge management, continual learning, and autonomous enterprise knowledge assistants, establishing RAG as a robust foundation for trustworthy and intelligent knowledge-driven AI systems.

Louis Pouzin, J. Arsac · 0 citations
Open access Aug 2026

Intelligent Document Processing Platform Using Retrieval-Augmented Generation (RAG)

An Intelligent Document Processing Platform using Retrieval-Augmented Generation to enable accurate, context-aware, and reliable document intelligence and offers a practical and scalable framework for intelligent document understanding, semantic search, and AI-assisted question answering in modern knowledge management environments.

J. Priya, M. Arathi · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.