Process Reward Modeling with Reliability- and Conservatism-Aware Bayesian Belief
BayesianPRM is proposed, which treats the process reward as a random variable within a reward hypothesis space and maintains a Bayesian belief over it, and yields a reliability- and conservatism-aware Bayesian belief, whose expectation determines the process reward.