HuatuoGPT-3: RL-Only Domain Adaptation from Base Models
Domain adaptation aims to turn a general-purpose large language model (LLM) into an expert for a target domain. While the dominant SFT+RL pipeline offers a convenient cold start, it may reduce exploration diversity and introduces additional complexity through multi-stage optimization. These limitations motivate RL-only...
Junying Chen, Xin-Yuan Xie, Zi-Niu Li et al.
· 0 citations