Is ChatGPT Gender-Neutral? Implicit Stereotyping Persists Over Time and With Experience

Abstract

ChatGPT, a chatbot powered by a large language model (LLM), is used by millions globally. Whether it is perceived as an anthropomorphic agent is currently being mapped out. Notably, the degree and nature of how ChatGPT is gendered remains unclear, despite agent gender cues being known to impact user attitudes and behaviors. ChatGPT, with its natural communication style and minimal gender cues, may offer radical insights on agent gendering. In this online mixed methods study, we invited first-time and experienced users to undertake tasks with ChatGPT. We surveyed their perspectives at two time-points following the interaction. Results indicated that ChatGPT’s communicative abilities correlated with gendered traits and its perceived capabilities reflected gender stereotypes. Our work suggests that ChatGPT is not gender-neutral, with implicit gender stereotyping occurring in the absence of gender cues and regardless of exposure. We advocate for conscientious design interventions to overcome agent-based perpetuation of human stereotypes.