Where Should a Document Live: Context, Representations, or Parameters?
A controlled comparison of representation-based (KV-cache based) and parametric (fine-tuning-based) adaptation methods on five knowledge-intensive benchmarks shows that in the oracle setting, Cartridges are the most accurate injection method at nearly every storage budget, outperforming parametric methods by 10 points.
Nathanaël Carraz Rakotonirina, Momchil Hardalov, Gonzalo Iglesias et al.
· 0 citations