Skip to content

LiteLLM: a lightweight transformer architecture for efficient short-text classification

Aug 2026 · Neural computing & applications (Print) · Vol 38 · 0 citations · 42 references

TL;DR

LiteLLM is introduced, a lightweight transformer architecture explicitly optimized for short-text scenarios that delivers competitive performance, fast convergence, and competitive cross-domain performance across heterogeneous short-text settings.

View source

Similar papers

Review Open access Jul 2026

Enhanced Sentiment Analysis Using RoBERTa and BiLSTM: A Context-Aware Hybrid Deep Learning Approach

This paper presents a context-aware hybrid deep learning approach by integrating the Robustly Optimized BERT Pretraining Approach (RoBERTa) with Bidirectional Long Short-Term Memory (BiLSTM) networks to generate rich contextual word embeddings.

V. Gayatri, Rajani Rajalingam · 0 citations
Open access 2026

Attention-Augmented Hybrid CNN- BiLSTM Architecture for Real-Time Sentiment Classification of Twitter Text

This study proposes a hybrid deep-learning framework that combines convolutional feature extraction with a bidirectional recurrent encoder and an attention mechanism to categories tweets as positive, neutral, or negative, and indicates that the learned representations generalize reasonably well across domains rather th...

K. Vadivelan, M. Rajan · 0 citations
Open access 2026

A Hybrid Framework for Large-Scale Tweet Sentiment Analysis Using Classical Machine Learning, Transformer Models, and Uncertainty Estimation

The work provides a reproducible, explainable, operationally applicable model of sentiment analysis in operationally sensitive, high-stakes Twitter sentiment analysis, and validate the hypothesis that hybrid stacking is an effective method for leveraging the complementary nature of lexical and contextual representation...

D. Abate, Nilay Mistry · 0 citations
Conference Open access Aug 2026

A Cost-Efficient Routing Pipeline for Multilingual Short-Text Classification Using Small Language Models

This work evaluates a fixed-list routing strategy that keeps stronger languages on a direct multilingual path and selectively sends weaker languages through translation into English before zero-shot classification, and reports routing through tier-level quality gains and tier-level latency rather than a single global e...

Wajdi Ben Saad, Safa Madiouni · 1 citation
Open access Jul 2026

Beyond The Surface: Characterizing Adversarial Boundaries in Synthetic Text Attribution Across Heterogeneous Domains

A hybrid detection framework which combines semantically deep embeddings from the RoBERTa transformer with a set of carefully designed language statistics and linguistic statistics and shows excellent resistance to the surface-level adversarial paraphrasing strategy.

Anita Rani, Suman · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.