Yi-Ping Yang

Integrating Video-Language Model with Mixture of Low-Rank Experts for Video Commonsense Captioning

A Video-Language Model with Mixture of Low-rank Adaptation Experts (VLM-MOLAE) that excels in understanding videos and performing commonsense reasoning, and utilizes a pre-trained large language model as the backbone to exploit its commonsense knowledge to facilitate comprehension and inference.