When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits
An ordered diagnostic protocol is given that screens a reward-and-policy candidate on two axes, alignment, alignment and learnability, and the end-to-end experience of applying it to a delayed-feedback CMAB is described.