Beyond Raw Engagement: A Counterfactual Observability Framework for Recommender Systems at Netflix
This work presents a general evaluation framework that enhances observability across multiple recommender systems at Netflix and demonstrates its effectiveness through several production deployments, and articulate three stakeholder-centered observability principles for content creators and model developers.