Boyang Xia

AI Alignment Training Paradigms and Cross-Model Differences in AI Persuasive Behavior

Reinforcement learning from human feedback (RLHF) and constitutional artificial intelligence (CAI) are two ways to shape model behavior. Among them, CAI is built around avoiding different categories of harm, including racism, sexism, toxic, dangerous and illegal content. This article integrates the existing empirical r...