Aug 2026· International Conference on Multimedia Analysis and Pattern Recognition· pp. 180-185· 0 citations· 17 references
Abstract
Vietnamese question answering (QA) is increasingly important for customer support and digital service applications, yet existing Vietnamese QA resources remain limited in scale, domain coverage, and task format. In this paper, we introduce Vi-FusionQA, a public unified benchmark for cross-domain Vietnamese question answering. Rather than targeting a single deployment setting, Vi-FusionQA is designed as a general-purpose benchmark, with OTT customer support used as a motivating example of a practical QA application. Vi-FusionQA aggregates multiple Vietnamese and multilingual QA resources into a shared context-question-answer schema, resulting in over 100,000 QA pairs with source-level traceability. We further enrich the dataset with LLM-generated pseudo reasoning types and difficulty labels to support exploratory dataset analysis. To establish baseline performance, we fine-tune representative open-weight LLMs, including Qwen and Llama variants, using LoRA and evaluate them with standard QA metrics. Experimental results show that Qwen3-4B-Instruct-2507 achieves the best full-dataset performance, reaching 68.22% F1 and 37% Exact Match. We also report system-level efficiency metrics, including training speed, GPU utilization, and power consumption, to support practical model selection for Vietnamese QA applications.
V\={a}kQA, a Telugu SQA benchmark of 2,001 factoid question-answer pairs across six domains, is introduced and it is observed that Telugu phrasing retains cultural specificity that is lost in translation, speech input introduces phonetic confusions that alter question meaning, and cascaded ASR-MT errors compound progre...
Bhavana Akkiraju, Ravi Sastry Kolluru, D. SriCharan et al.· 0 citations
A systematic analysis of existing evaluation frameworks and metrics for RAG-based Question Answering (QA) systems reveals urgent needs for hybrid evaluation frameworks, reasoning path traceability, combined pipeline assessment, and harmlessness evaluation, laying groundwork for the next generation of evaluation methodo...
Extractive question answering (QA) aims to locate precise answer spans within a text passage for a given question, which is crucial for applications such as virtual assistants, information retrieval, and domain-specific tools. Transformer-based models like BERT have achieved high accuracy on benchmark datasets, yet the...
Raveendra Malle, Siva Prasad Patnayakuni· Adolescência e Saúde· 0 citations
We present L3Cube-IndicQuest v2, a large-scale gold-standard multilingual question-answering benchmark for evaluating the India-specific factual knowledge of Large Language Models (LLMs). The benchmark comprises 3,471 curriculum-grounded English question--answer pairs spanning nine domains, curated from educational cur...
Rinit Jain, Tirthraj Mahajan, Advait Joshi et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.