User Perceptions vs. Proxy LLM Judges: Privacy and Helpfulness in LLM Responses to Privacy-Sensitive Scenarios
The need for more user-centered studies to measure LLMs'ability to help users while preserving privacy, and for improving alignment between LLMs and users in estimating perceived privacy and utility, is discussed.