Preprint
Aug 2026
Advancing Relevance Measurement with Vision-Language Models for Web-Scale Search
A VLM-based automated relevance evaluation pipeline deployed within Pinterest Search for online A/B experiments is presented, demonstrating that VLMs can provide reliable relevance measurement for experiments while greatly improving the evaluation efficiency.
Han Wang, Alex P. Whitworth, Pak-Ming Cheung et al.
· 0 citations