Social Caption: Evaluating Social Understanding in Multimodal Models
SOCIAL CAPTION is introduced, a framework grounded in interaction theory to evaluate social understanding abilities of MLLMs along three dimensions: Social Inference, the ability to make accurate inferences about interactions; Holistic Social Analysis, the ability to generate comprehensive descriptions of interactions;...