Does Reasoning Improve Psychological Depth in Large Language Models? It Depends on Who's Judging
The results suggest that development-set performance is insufficient evidence for deployment validity on a shifted distribution, and that point-estimate judges can obscure the heterogeneity in subjective human evaluation.