Deep Weighted Bellman Residual Minimization for $Q^*$ Estimation
A weighted Bellman residual minimization framework that incorporates density ratio weighting by effectively integrating expert demonstrations with behavioral data is introduced, providing specific guidance for the rational utilization of expert demonstrations.