Human Psychometric Questionnaires Mischaracterize LLM Behavior
This study indicates that questionnaire scores alone should not be treated as evidence of LLMs'response tendencies in realistic user interactions, and supports generation-probability profiling with ecologically valid items as a complementary behavioral measure.
Woojung Song, Dongmin Choi, Yoonah Park et al.
· 1 citation