It is shown that multi-prompt aggregation substantially improves robustness by emphasizing judgments that remain consistent across prompt variants, and it is shown that multi-prompt aggregation substantially improves robustness by emphasizing judgments that remain consistent across prompt variants.
Ilija Subasic, Brett Levert, Andrew Rabinovich et al.· 0 citations
Language models in customer-facing products must be continually updated, since the data they serve shifts over time. As retraining on the full accumulated data is impractical, each update should instead run on a small set of examples carrying the training signal of all data seen so far. The strongest current methods bu...
Sajjad Pakdamansavoji, Mohammad Reza Rezaei, Ilija Subasic et al.· 0 citations
LLM-as-a-Judge has become a standard for evaluating large language models, yet most approaches implicitly assume that a single judge prompt functions as a stable evaluation instrument. Prior work has primarily explored deliberate prompt modifications such as scoring rubrics, role descriptions, or chain-of-thought reaso...
Ilija Subasic, Brett Levert, Andrew Rabinovich et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.