Skip to content

Augmenting Datasets for Fine-Tuning Large Language Models Using Semantic Variations

2026 · TEXT2KG/BiKE@ESWC · pp. 84-97 · 0 citations · 35 references
Computer Science

TL;DR

This study explores a semantic variation methodology to augment training data by generating question-answer pairs with explicit control over semantic similarity, and shows that semantically controlled augmentation improves domain-specific knowledge acquisition while preserving consistency.

View source

Similar papers

Conference Jul 2026

Inventive Meta-Learning Strategies for Cross-Domain Natural Language Understanding in Distributed Knowledge Bases

Natural Language Understanding (NLU) addresses cross-domain challenges in understanding language due to inconsistent data distributions, uncertain concept semantics, and inconsistent language use specific to individual domains across different geographical locations. The majority of classical deep learning systems perf...

Deepti Patnaik, Rakshak Bharti · 0 citations
Open access Jul 2026

Integrating Heterogeneous Knowledge for Enhanced Recommendation with Large Language Models

The proposed REKALM, a comprehensive integration framework for enhancing LLM-based recommenders through knowledge integration, demonstrates that augmenting LLMs with lexicalized, domain-specific knowledge is an effective system-level strategy for advancing the next generation of recommender systems.

Alessandro Petruzzelli, C. Musto, Marco De Gemmis et al. · 0 citations
Jul 2026

MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQA

This work proposes MARS, a scalable knowledge graph question answering (KGQA) approach that requires no model fine-tuning, and performs a structured retrieval procedure that links question entities to the KG and iteratively retrieves relevant next-hop information.

Nikit Srivastava, Daniel Vollmers, René Speck et al. · 0 citations
Open access 2026

Design and Evaluation of Large Language Model Approaches for Text2Cypher Generation in Domain-Specific Knowledge Graphs

A comparative study conducted within BMW AG, focusing on the application of LLM-based Text2Cypher generation for querying a domain-specific knowledge graph designed to support virtual product development, reveals that the primary challenge in industrial Text2Cypher generation lies in correctly interpreting domain-speci...

Carolin Lehmacher, Efe Kamasoglu, Kristin Paetzold-Byhain · 0 citations
Open access 2026

Asking language models how to represent data for fine-tuning

It is shown that format choice remains important even after fine-tuning; models learn more efficiently with specific formats rather than adapting to any format; this finding allows format selection to be done via inference alone, avoiding costly trial-and-error fine-tuning runs.

Usneek Singh, Ananya Singha, Abhijeet Awasthi et al. · 0 citations
Open access Aug 2026

Towards Building a Multi-Source Heterogeneous Knowledge Graph for Complex Material Question Answering

Results indicate that integrating multi-source domain knowledge with relation-preserved retrieval and attribute-supported filtering provides more focused and inspectable evidence, thereby supporting more accurate complex material question answering.

Peize Li, Xi Guo, Nan Yin et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.