Aug 2026· International Journal of Electrical and Computer Engineering (IJECE)· 0 citations
TL;DR
What stands out is how compressed models running locally can still catch up in understanding classroom content, and building tutors powered by artificial intelligence becomes safer when data never leaves the device and outside services are not needed at all.
Abstract
New students often struggle when short articles clash with thick textbooks. Still, even though large language models offer some teaching support, standard online setups lack focused accuracy - sometimes making things up - and risk user data control. Here comes an idea: build a tightly tested, self- contained system that aligns learning materials automatically without needing the internet, keeping information private by design. One look at two setups shows how they handle local reasoning differently. Instead of using both encoder and decoder parts, one system skips the encoder entirely. That simpler design grabs full context through ChromaDB without shrinking the data first. Meanwhile, the older type crunches input down, losing meaning along the way. Even though it runs fast - just under a second - errors pop up often, four out of five responses drifting off course. On the flip side, the new method builds correct code nearly every time, adds clear explanations tied to lesson goals, yet takes more than fourteen seconds to reply. Slower? Yes. More accurate? Clearly. What stands out is how compressed models running locally can still catch up in understanding classroom content. Another key point emerges: building tutors powered by artificial intelligence (AI) becomes safer when data never leaves the device and outside services are not needed at all.
This paper mainly talks about how Retrieval-Augmented Generation frameworks are making document-based question-answering smarter and more reliable than traditional models, and explores different types of RAG techniques like dense retrieval, vector database optimization, generative language model integration, and hybrid search frameworks.
Manthan Meshram, Kunalgir Ridhanarthi, Darshan Khirekar· Best Journal of Innovation i...· 0 citations
Due to the surge in digital document creation, intelligent systems that can effectively retrieve accurate information from unstructured PDF content have become a necessity. Current keyword-based search techniques lack semantic meaning, while large language models (LLMs), when utilized individually, produce hallucinated results when they are not contextually aware of document content. In this paper, we introduce a novel real-time question answering system for PDF content using a lightweight approach to Retrieval-Augmented Generation (RAG). Our system combines a HuggingFace sentence transformer model for semantic embeddings with a FAISS vector similarity search for efficient retrieval, leveraging a Groq-hosted LLaMA 3.3 70B model for context-grounded answer generation. The system is built using LangChain for orchestration and Streamlit for web-based deployment, and requires no GPU, no fine-tuning, and no pre-indexed corpus. Evaluation across five complementary metrics—Exact Match, Token-level F1, BLEU, ROUGE, and semantic similarity—demonstrates strong alignment between generated and reference answers, with a peak semantic similarity of 0.8709 and a mean Token F1 of 0.4701, confirming the viability of this approach for real-world document intelligence.
Mukesh Lakshmi Sai Medikonda, Kalva Vishnu Teja, K. Greeshma et al.· International Conference Com...· 0 citations
This paper presents the design and implementation of intelligent chatbots using Retrieval-Augmented Generation architecture to derive accurate, context-based responses from domain-specific knowledge sources such as PDFs and CSV files. The proposed system integrates information retrieval mechanisms with large language models to overcome crucial limitations of traditional chatbots: hallucination, knowledge cut-off, and inability to access private organizational data. The proposed architecture uses a six-stage pipeline consisting of document ingestion, text splitting, and embedding generation with sentence transformers, semantic retrieval, and response generation via Large Language Models (LLMs). By preprocessing the PDF and CSV documents using a RecursiveCharacterTextSplitter and converting them into 384-dimensional semantic embeddings, the system works via a similarity-based retrieval of document chunks. For implementation, the LlamaIndex framework was used for data indexing and query orchestration, and HuggingFace Transformers for language modeling. Experimental validation conducted on the smart campus chatbot system demonstrated significant improvements in the accuracy, relevance and transparency of responses across education, student services, and administrative support domains compared with a standalone language model. Because of its modular design, it supports a wide range of domain-specific topics without the combinatorial costs of re-training. This is another important application for systems that require regular updates and accurate information. Overall, the proposed framework provides a simple and practical approach for easily implementing domain-aware chatbots.
Varsha Spoorthi Shree Narravula, V. K, Yashaswini B. Suresh et al.· 2026 7th International Confe...· 0 citations
Generative retrieval has become an increasingly adopted paradigm for industrial search, recommendation, and advertising systems, delivering significant online gains. Most existing work combines user behavior sequences with large language models (LLMs) to model user preferences. In practice, feature engineering remains critical to model effectiveness, yet its complexity slows offline iteration and makes online deployment heavy and hard to reuse, all under tight online latency budgets. The root cause is a tight coupling between feature-processing logic and model architecture, where every feature change touches the training and serving code and resists reuse across scenarios. To break this coupling, we present Prompt Generation (PG), a high-level tokenizer and configuration-driven framework that decouples feature-processing logic from model architecture through two declarative JSON files, which serve as the single source of truth for both offline training and online serving, ensuring feature consistency across the two stages. Organizing features under four types with three composable processing components to assemble and compress heterogeneous features, PG delivers acceleration at three levels: (1)fast training iteration: feature experiments require only configuration changes, with built-in token compression for ultra-long sequences; (2)fast deployment: a new scenario only needs to conform to the PG schema and plug into a universal pipeline, with no scenario-specific engineering; (3)fast online inference: engine applies unified optimizations over the standardized configuration, reducing PG's overhead to a negligible level. PG has been deployed on Taobao Search with statistically significant online A/B uplifts of +0.47% in transaction count and +0.51% in GMV, and has been applied across multiple Taobao search and recommendation teams as the iteration framework for generative retrieval.
University service centers handle many repetitive queries about academic schedules, registration, and policies stored in internal documents. Manual lookup is inefficient, and answers given by staff can be inconsistent. Rule-based chatbots only handle limited question patterns, while large language models are hard to update and may produce unsupported answers (hallucinations). This research designs an academic chatbot that combines document retrieval with answer generation so that each answer remains traceable to its source. The system extracts text from campus documents, segments it, encodes it using a multilingual embedding model, and stores it in a vector index for context retrieval. A response is generated through an instruction template that confines the output to the retrieved information and includes page references. Evaluation followed a mixed-method design: a quantitative layer measured retrieval quality (Precision@5, Recall@5) and generation quality using the four RAGAS sub-metrics (faithfulness, answer_relevancy, context_precision, context_recall) on a 100-question test set, while a qualitative layer applied thematic analysis to open-ended user comments. Statistical testing used McNemar's test for accuracy and a paired bootstrap (10,000 resamples) for retrieval metrics; 95% confidence intervals are reported. Results: the proposed RAG system achieved 84% answer accuracy (95% CI 76–90%), Precision@5 = 0.80 and Recall@5 = 0.72, with a System Usability Scale (SUS) score of 78 and a Net Promoter Score (NPS) of +32 from 30 participants. Differences in accuracy versus the lexical and LLM-only baselines were statistically significant (McNemar p < 0.05). The system offers a replicable instantiation of RAG for transparent, citation-backed campus information services in Indonesian.
Haddad Alwi Yafie, A. Zailani, Widang Muttaqin et al.· SinkrOn· 0 citations
Data structures and algorithms (DSA) form a cornerstone of computer science education, yet many students in Nepal struggle with the cognitive load imposed by English-only learning materials when their habitual conceptual language is a code-mixed register of Romanized Nepali and English. This paper presents the design, implementation, and classroom evaluation of an NLP-driven educational chatbot, AlgoSathi, that addresses this gap through a Retrieval-Augmented Generation (RAG) architecture tailored to code-mixed pedagogical queries. The system combines a curated DSA knowledge base of 1,252 chunks drawn from instructor-authored lecture notes, textbook material, and worked solutions; a multilingual sentence encoder (paraphrase-multilingual-mpnet-base-v2) backed by an HNSW-indexed FAISS vector store; a hybrid BM25-plus-dense retriever with a cross-encoder re-ranker; and a large language model generator constrained by a pedagogically structured prompt that preserves the language register of the learner's query. A 12-week quasi-experimental study with 52 undergraduates (26 experimental, 26 control) showed the chatbot group achieved a 26.2-point mean learning gain versus 14.5 points for controls (t (50) =4.21, p<0.001, d=1.17, 95% CI for gain difference: 6.2-17.2pp). ANCOVA using pre-test scores as a covariate confirmed a significant adjusted post-test advantage of 12.1 points (95% CI: 7.4–16.8, p < 0.001). Statistical assumption checks (Shapiro-Wilk, Levene's test) and a priori power analysis (power = 0.97) are reported. The retrieval pipeline reached P@5=0.79 on code-mixed queries, with student satisfaction averaging 4.31/5. Results suggest that code-mixing-aware RAG chatbots can meaningfully improve DSA learning outcomes while remaining feasible for instructor-led deployment in low-resource settings.
Saroj Bhandari, Puja Dhital· Aadim Journal of Multidiscip...· 0 citations