Skip to content
Book Open access

Unified Semantic Modeling Framework for Large-Scale Job Understanding at LinkedIn

Jun 2026 · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval · pp. 5015-5020 · 0 citations · 37 references
Computer Science

TL;DR

A unified semantic modeling framework powered by a small language model (SLM) to address the challenges of job understanding in structured and unstructured contexts and provides practical insights into building industry-scale text understanding systems.

Abstract

Job understanding is critical to LinkedIn's mission of connecting talent with opportunity. This task involves transforming unstructured and noisy job postings into standardized or derived job attributes that power numerous LinkedIn products. However, building a scalable, cost-efficient, and high-performing job understanding system remains challenging. In this paper, we present a unified semantic modeling framework powered by a small language model (SLM) to address the challenges. We begin by fine-tuning an open-source SLM using a suite of carefully curated synthetic tasks augmented with reasoning traces. These tasks jointly target taxonomy-guided classification and taxonomy-agnostic entity extraction. This allows the resulting model to acquire robust zero-shot generalization for job understanding in structured and unstructured contexts. Building upon this foundation, we introduce a multi-adapter architecture with attribute grouping to facilitate efficient task-specific adaptation while streamlining model management across diverse downstream attributes. Offline evaluations and online A/B tests demonstrate significant performance improvement while reducing operational complexity. Our work provides practical insights into building industry-scale text understanding systems.

Read PDF

Similar papers

2026

Augmenting Datasets for Fine-Tuning Large Language Models Using Semantic Variations

This study explores a semantic variation methodology to augment training data by generating question-answer pairs with explicit control over semantic similarity, and shows that semantically controlled augmentation improves domain-specific knowledge acquisition while preserving consistency.

Alexander Chen, Caroline Tang, Jennifer Sleeman · 0 citations
Open access Aug 2026

TaSC-LLM: A Large Language Model–Enabled Business Intelligence Framework for Topic Analytics in Live-Streaming E-Commerce Systems

In live-streaming e-commerce systems, massive volumes of user-generated danmaku constitute a critical yet underutilized source of business intelligence. However, transforming such unstructured, noisy, and highly context-dependent textual data into structured and actionable knowledge remains a fundamental challenge for enterprise information systems. To address this issue, this study proposes TaSC-LLM, an LLM-enabled topic recognition method for constructing interpretable topic measurements from unstructured user-generated content. The proposed framework integrates topic taxonomy construction and zero-shot classification into a unified semantic reasoning pipeline. Unlike conventional topic modeling or supervised classification approaches, TaSC-LLM leverages chain-of-thought reasoning, multi-stage taxonomy induction, sliding window context modeling, and self-consistency verification to eliminate reliance on predefined label spaces and annotated training data. This design allows the system to dynamically construct and update topic taxonomies while ensuring interpretability, robustness, and cross-scenario adaptability. Empirical evaluation on three large-scale live-streaming e-commerce danmaku datasets shows that TaSC-LLM achieves strong taxonomy coverage, classification accuracy, and agreement with expert annotations. The findings suggest that LLM-based reasoning can help convert unstructured user-generated text into interpretable topic measures for downstream empirical and managerial analysis. While the present evaluation is conducted offline, TaSC-LLM provides a methodological foundation for future business applications that can be further examined under multi-session, multi-platform, and deployment-oriented conditions.

Geng Peng, Xiaoxi Wang, Ruoshi Zhang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

DocHop: Benchmarking Out-of-domain Multi-hop Reasoning in Information-Dense Documents

Multimodal Large Language Models (MLLMs) have achieved strong performance on structured visual understanding tasks such as chart and document question answering. However, existing benchmarks typically evaluate these domains in isolation, leaving underexplored a key capability: whether models can use textual context to determine how chart evidence should be selected, interpreted, and aggregated. We introduce DocHop, a benchmark for integrated chart--context reasoning in document-style images. In DocHop, the document narrative specifies multi-step compositional constraints, while charts provide the corresponding data values. Questions are grounded on a semantic reference label defined in the narrative, requiring models to resolve target entities from context before aggregating evidence across multiple charts. To enable systematic evaluation, we construct DocHop via a stochastic logic-first generation pipeline with controllable reasoning depth and visual density, covering 2,074 examples across six task categories. Experiments on a wide range of proprietary and open-source MLLMs show a substantial gap to human performance: annotators achieve over 90% accuracy, while the best model reaches only 62.83%. Reasoning-enhanced models consistently show improved results, but performance degrades as reasoning complexity increases. Overall, DocHop provides a controlled testbed for challenging multi-hop document reasoning.

Zhuoran Yu, Le Thien Phuc Nguyen, Jaden Park et al. · 0 citations
Book Open access Aug 2026

AgentsKG: A Hierarchical Multi-Agent Framework for Open-Domain Knowledge Graph Construction

Knowledge Graph Construction (KGC) is essential for transforming unstructured text into structured knowledge representations. Despite advances in Large Language Models, existing methods treat KGC as a single-pass generation task, conflating extraction, normalization, and validation within a single forward pass. This leads to hallucinated facts, polysemous conflation, and fragmented triples, particularly in open-domain settings where predefined schemas are unavailable. In this work, we propose AgentsKG, a hierarchical multi-agent framework that decouples semantic perception from structural integration. In the Semantic Perception Layer, a multi-role Verification Committee filters hallucinated and invalid assertions through majority voting, while a Contextual Profiler resolves polysemous ambiguities by enriching mentions with context-dependent semantic descriptors. In the Structural Integration Layer, a Knowledge Linker merges redundant entities and relations based on semantic profiles, and an Ontological Logic Auditor enforces logical consistency across the graph. Extensive experiments demonstrate that AgentsKG outperforms state-of-the-art training-free baselines in both extraction accuracy and structural quality, offering a robust approach to open-domain knowledge graph construction without additional training. Source code is available at https://doi.org/10.5281/zenodo.20484211

Shilong Liu, Yongqiang Liu, Jiye Liu et al. · 0 citations
#artificial intelligence Preprint Aug 2026

pro-team at LLMs4OL 2026 Tasks Flagship and Reuse: Retrieval-Augmented Generation and Vocabulary-Constrained Filtering for Ontology Learning

Ontology learning from text remains challenging despite significant progress in Large Language Models (LLMs), which can hallucinate domain terms, produce inconsistent formats, and favor hierarchical over associative relations. In the LLMs4OL 2026 Challenge, we address both the End-to-End Flagship Task (Task A) and Ontology Extension Reuse Task (Task B) using an offline retrieval-augmented few-shot prompting pipeline. Our system employs Qwen2.5-14B-Instruct with all-MiniLM-L6-v2 for demonstration retrieval, selecting the top-5 examples for Task A and top-2 for Task B. A left-truncated context-windowing strategy preserves task instructions within long prompts. For Task B, generated triples undergo deterministic vocabulary-constrained filtering, retaining triples when at least one endpoint belongs to the sample's closed term/type vocabulary and removing duplicates of the initial ontology. The approach achieves Semantic Graph Similarity of 0.8692, Term-Typing F1 of 0.9200, and Taxonomy Discovery F1 of 0.8540 on Task B, while Task A achieves 0.7416 Semantic Graph Similarity. However, no non-taxonomic relations are extracted, highlighting limitations of closed, taxonomy-oriented relation vocabularies.

Shivam Mishra, Dhannu Ram Meena, M. Ojha et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.