Skip to content

LLM-Enhanced Dual-Branch Learning for Large-Scale Multi-Label Text Classification

Sep 2026 · 0 citations · 27 references
Computer Science

TL;DR

DualMLC is proposed, a dual-branch framework that processes the same document through an autoregressive decoder-only language model and a bidirectional encoder, achieving state-of-the-art results on three widely used large-scale multi-label text classification benchmarks.

Abstract

Large-scale multi-label text classification assigns a small subset of relevant labels to each document from a vocabulary containing thousands or tens of thousands of candidate labels. Although pretrained language models have improved semantic text representations, most representation-based approaches center their prediction pipelines on a primary encoder or combine auxiliary features within a single ranker. The complementarity between heterogeneous language models therefore remains insufficiently explored. We propose DualMLC, a dual-branch framework that processes the same document through an autoregressive decoder-only language model and a bidirectional encoder. Each branch maintains its own representation pathway and independently estimates relevance scores over the shared label space. DualMLC combines the two score vectors through late logit fusion, allowing shared evidence to reinforce relevant labels and branch-specific evidence to compensate for limitations in the other branch's representation. DualMLC achieves state-of-the-art results on three widely used large-scale multi-label text classification benchmarks. Ablation results further confirm that integrating the heterogeneous predictors produces stronger rankings than either branch alone. The source code is publicly available at https://github.com/huiyegit/DualMLC.

View source

Similar papers

HyperLabel: Multi-Label Classification via Hypergraph-Based Label Correlation Modeling

This work proposes HyperLabel, an encoder-decoder framework that explicitly models label dependencies through hypergraph neural networks, and proposes a unified cross-modal learning approach where HGNN+ performs bidirectional message passing to integrate feature information with label structure, and a shared cross-atte...

Pei-Yu Zhang, Heng Ping, Nikos Kanakaris et al. · 0 citations
Preprint Aug 2026

Towards Purified Multi-Label Test-Time Adaptation of Vision-Language Models

PuRF is introduced, a novel PuRiFication-driven cache-based method for multi-label test-time adaptation of vision-language models that consistently outperforms state-of-the-art methods on ViT-B/32 across five datasets.

Yiwen Liang, Hui Chen, Yizhe Xiong et al. · 0 citations
Conference Open access Aug 2026

A Cost-Efficient Routing Pipeline for Multilingual Short-Text Classification Using Small Language Models

This work evaluates a fixed-list routing strategy that keeps stronger languages on a direct multilingual path and selectively sends weaker languages through translation into English before zero-shot classification, and reports routing through tier-level quality gains and tier-level latency rather than a single global e...

Wajdi Ben Saad, Safa Madiouni · 1 citation

On the Influence of Hyperparameters in Tree-Based Linear Methods for Extreme Multi-Label Text Classification: Insights for Efficient and Effective Search

This study innovatively analyzes the hyperparameters of tree-based linear methods and suggests an efficient and effective guideline that leads to consistent improvements across datasets, thereby strengthening tree-based linear methods as a stronger XMTC baseline.

Kuan-Ting Chen, Hung-Chih Chiang, Chih-Jen Lin · 0 citations
Open access Aug 2026

Label space reduction for transductive zero-shot classification with large language models

This work proposes distilling the model into a probabilistic classifier, enabling lightweight deployment without repeated LLM calls, and demonstrates that LSR improves macro-F1 scores by an average of 7.0% compared to standard zero-shot classification baselines.

Nathan Vandemoortele, Bram Steenwinckel, F. Ongenae et al. · 0 citations
Book Open access Aug 2026

On the Transferability Between Extreme Multi-Label and Hierarchical Text Classification

Extreme multi-label classification (XML) and hierarchical text classification (HTC) address closely related multi-label prediction problems, but have largely developed as separate research areas. XML focuses on very large label spaces and typically evaluates ranked label lists, while HTC assumes a human-curated label h...

Florian Hauss, Tom Speier, Nerijus Bertalis et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.