This work uses Reinforced Self-Training (ReST) to train the model to achieve high reward and shows this leads to a steerable policy that changes its behavior predictably conditioned on the provided costs, leading to higher reward and accuracy.
Jonathan Berant, M. Chen, Adam Fisch et al.· arXiv.org· 6 citations· ⚡2
Experiments across three domains show that Pandora's Router matches the routing quality of exhaustive estimation, while querying the expensive estimator far less often.
Adam Fisch, Shubhendu Trivedi, Fantine Huot et al.· 1 citation
Routing policies for multi-model systems are evaluated almost exclusively on task accuracy and inference cost. We argue that two properties, orthogonal to performance, determine whether routing is meaningful. First, the society of actors must be behaviourally differentiated: if all actors respond identically, routing i...
Fantine Huot, Michael Kaisers, Mirella Lapata· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.