Results indicate that HiPDA provides a structured and effective framework for multimodal sentiment modeling, which organizes multimodal modeling in a progressive injection–fusion–alignment manner.
The multi-view text-guided multimodal fusion adapter (MVFA) is proposed, a parameter-efficient framework that augments frozen LLMs with strong multimodal reasoning capability and achieves state-of-the-art performance on key metrics while updating only a small fraction of parameters.
Peng-Fei Shao, Ji-Sheng Dang, Jia-Wen Fang et al.· 0 citations
Multimodal sentiment analysis aims to improve cross-modal fusion to understand sentiment better. Most existing methods rely on single-stage fusion or local cross-modal interactions, making it difficult to fully capture relationships among modalities, thereby limiting their sentiment representation capabilities and...
Guang-Yu Mu, Jia-Xiu Dai, Yuan-Yuan Yue et al.· Aslib Journal of Information...· 0 citations
Multimodal sentiment analysis is vulnerable to unstable local cues and temporal asynchrony among textual, visual, and acoustic signals. Existing fusion methods extensively model cross-modal interaction, but lightweight mechanisms that regularize intermediate representations before temporal alignment remain limited. Thi...
Xing-Xing Zhang, Xing-Lin Zhang, Ang Chen et al.· IEEE Signal Processing Lette...· 0 citations
SemMSA, a latent semantic-aided framework that constructs rich sentiment-relevant semantics with LLMs, fully integrating with all modalities via anchor-free spectral alignment, is proposed.
Wen-Hao Li, Zhi-Bin Wu, Chong-Yao Xiao et al.· 0 citations
MGSI first encodes audio and visual streams at short-, medium-, and long-range temporal scales, preserving both local variations and global affective trends, and applies polarity- and intensity-aware enhancement to better handle ambiguous and near-neutral samples.
Shanshan Lin, Yuesheng Wu, Chao Chen et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.