Jun 2026· Annual International ACM SIGIR Conference on Research and Development in Information Retrieval· pp. 5015-5020· 0 citations· 37 references
Computer Science
TL;DR
A unified semantic modeling framework powered by a small language model (SLM) to address the challenges of job understanding in structured and unstructured contexts and provides practical insights into building industry-scale text understanding systems.
Abstract
Job understanding is critical to LinkedIn's mission of connecting talent with opportunity. This task involves transforming unstructured and noisy job postings into standardized or derived job attributes that power numerous LinkedIn products. However, building a scalable, cost-efficient, and high-performing job understanding system remains challenging. In this paper, we present a unified semantic modeling framework powered by a small language model (SLM) to address the challenges. We begin by fine-tuning an open-source SLM using a suite of carefully curated synthetic tasks augmented with reasoning traces. These tasks jointly target taxonomy-guided classification and taxonomy-agnostic entity extraction. This allows the resulting model to acquire robust zero-shot generalization for job understanding in structured and unstructured contexts. Building upon this foundation, we introduce a multi-adapter architecture with attribute grouping to facilitate efficient task-specific adaptation while streamlining model management across diverse downstream attributes. Offline evaluations and online A/B tests demonstrate significant performance improvement while reducing operational complexity. Our work provides practical insights into building industry-scale text understanding systems.
This study explores a semantic variation methodology to augment training data by generating question-answer pairs with explicit control over semantic similarity, and shows that semantically controlled augmentation improves domain-specific knowledge acquisition while preserving consistency.
Alexander Chen, Caroline Tang, Jennifer Sleeman· TEXT2KG/BiKE@ESWC· 0 citations
In live-streaming e-commerce systems, massive volumes of user-generated danmaku constitute a critical yet underutilized source of business intelligence. However, transforming such unstructured, noisy, and highly context-dependent textual data into structured and actionable knowledge remains a fundamental challenge for enterprise information systems. To address this issue, this study proposes TaSC-LLM, an LLM-enabled topic recognition method for constructing interpretable topic measurements from unstructured user-generated content. The proposed framework integrates topic taxonomy construction and zero-shot classification into a unified semantic reasoning pipeline. Unlike conventional topic modeling or supervised classification approaches, TaSC-LLM leverages chain-of-thought reasoning, multi-stage taxonomy induction, sliding window context modeling, and self-consistency verification to eliminate reliance on predefined label spaces and annotated training data. This design allows the system to dynamically construct and update topic taxonomies while ensuring interpretability, robustness, and cross-scenario adaptability. Empirical evaluation on three large-scale live-streaming e-commerce danmaku datasets shows that TaSC-LLM achieves strong taxonomy coverage, classification accuracy, and agreement with expert annotations. The findings suggest that LLM-based reasoning can help convert unstructured user-generated text into interpretable topic measures for downstream empirical and managerial analysis. While the present evaluation is conducted offline, TaSC-LLM provides a methodological foundation for future business applications that can be further examined under multi-session, multi-platform, and deployment-oriented conditions.
Multimodal Large Language Models (MLLMs) have achieved strong performance on structured visual understanding tasks such as chart and document question answering. However, existing benchmarks typically evaluate these domains in isolation, leaving underexplored a key capability: whether models can use textual context to determine how chart evidence should be selected, interpreted, and aggregated. We introduce DocHop, a benchmark for integrated chart--context reasoning in document-style images. In DocHop, the document narrative specifies multi-step compositional constraints, while charts provide the corresponding data values. Questions are grounded on a semantic reference label defined in the narrative, requiring models to resolve target entities from context before aggregating evidence across multiple charts. To enable systematic evaluation, we construct DocHop via a stochastic logic-first generation pipeline with controllable reasoning depth and visual density, covering 2,074 examples across six task categories. Experiments on a wide range of proprietary and open-source MLLMs show a substantial gap to human performance: annotators achieve over 90% accuracy, while the best model reaches only 62.83%. Reasoning-enhanced models consistently show improved results, but performance degrades as reasoning complexity increases. Overall, DocHop provides a controlled testbed for challenging multi-hop document reasoning.
Zhuoran Yu, Le Thien Phuc Nguyen, Jaden Park et al.· 0 citations
Knowledge Graph Construction (KGC) is essential for transforming unstructured text into structured knowledge representations. Despite advances in Large Language Models, existing methods treat KGC as a single-pass generation task, conflating extraction, normalization, and validation within a single forward pass. This leads to hallucinated facts, polysemous conflation, and fragmented triples, particularly in open-domain settings where predefined schemas are unavailable. In this work, we propose AgentsKG, a hierarchical multi-agent framework that decouples semantic perception from structural integration. In the Semantic Perception Layer, a multi-role Verification Committee filters hallucinated and invalid assertions through majority voting, while a Contextual Profiler resolves polysemous ambiguities by enriching mentions with context-dependent semantic descriptors. In the Structural Integration Layer, a Knowledge Linker merges redundant entities and relations based on semantic profiles, and an Ontological Logic Auditor enforces logical consistency across the graph. Extensive experiments demonstrate that AgentsKG outperforms state-of-the-art training-free baselines in both extraction accuracy and structural quality, offering a robust approach to open-domain knowledge graph construction without additional training. Source code is available at https://doi.org/10.5281/zenodo.20484211
Shilong Liu, Yongqiang Liu, Jiye Liu et al.· Proceedings of the 32nd ACM...· 0 citations
Ontology learning from text remains challenging despite significant progress in Large Language Models (LLMs), which can hallucinate domain terms, produce inconsistent formats, and favor hierarchical over associative relations. In the LLMs4OL 2026 Challenge, we address both the End-to-End Flagship Task (Task A) and Ontology Extension Reuse Task (Task B) using an offline retrieval-augmented few-shot prompting pipeline. Our system employs Qwen2.5-14B-Instruct with all-MiniLM-L6-v2 for demonstration retrieval, selecting the top-5 examples for Task A and top-2 for Task B. A left-truncated context-windowing strategy preserves task instructions within long prompts. For Task B, generated triples undergo deterministic vocabulary-constrained filtering, retaining triples when at least one endpoint belongs to the sample's closed term/type vocabulary and removing duplicates of the initial ontology. The approach achieves Semantic Graph Similarity of 0.8692, Term-Typing F1 of 0.9200, and Taxonomy Discovery F1 of 0.8540 on Task B, while Task A achieves 0.7416 Semantic Graph Similarity. However, no non-taxonomic relations are extracted, highlighting limitations of closed, taxonomy-oriented relation vocabularies.
Shivam Mishra, Dhannu Ram Meena, M. Ojha et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.