CEM MoE: A Lightweight Sparse Mixture of Experts Framework for Empathetic Dialogue Generation
Empathetic dialogue generation requires models to understand user emotions and produce fluent, relevant, and emotionally appropriate responses. Existing lightweight models offer favorable deployment efficiency, but shallow emotion prediction layers limit their ability to represent fine-grained and dynamically changing...